Puppies can be a real handful, they are just so destructive and playful. Eventually they grow up but until they do crates and enclosed pens can really help. Until then they are chewing, digging, scratching, and whatever else they can do to destroy things. They can be quite good at destruction. Mine two are 8 years old. I've taken down a lot of the barriers I put up to keep them from killing some plants and destroying other things, but my screen savers are still in place. I could probably remove them now but replacing window screens used to be a regular occupation around here.
Something else that might come in handy is an electric fence. You bury a wire a couple of inches deep around their area and put a collar on the dog. If the dog gets close to the wire the collar starts to beep as a warning. If it gets too close it gets a shock. There is some training involved. I used flags to mark the boundary for a few weeks to help them learn what their limits were. It doesn't take many times of them getting shocked until they learn where their boundaries are. Mine still test those boundaries but as long as they hear the beep they stay inside.
I also have a pen built in back where I can lock he dogs in (or out) when I want to, but you might wan to consider an electric fence. It's not that hard to install and somehow I've managed to not cut that shallow wire yet. Other than the batteries on the collars eventually running out, mine's been very dependable.