If you don't get all the water out and it freezes is a likely culprit. it stretches the hose and weakens it. I've had mice chew on hoses in storage and ruin them. Sometimes kinked hoses can weaken at the kink. Sometimes hoses just get old.
Is it blowing a hole in the hose itself or is it at a fitting?
You can get an inline valve to screw into the hose, say at the spigot, and reduce pressure. I use those a lot. Sometimes I just want water to barely dribble out, say I'm irrigating. And sometimes I put one where I can shut the water off without going all the way back to the spigot, say I want to move a sprinkler without getting soaked.
I think you just have a bad hose and need a new one but you can try to reduce pressure if you want to.
