Welcome to TEG @Jillra65 , from the now not-so-chilly state of Wisconsin!
Nothing wrong with a brown thumb; good soil = good plants.
There are a lot of animals you can fence out, discourage or have a "live and let live" coexistence; but IMO ground hogs are not one of those. If you begin a vegetable garden, it is only a matter of time (and probably not long) before they overcome any barriers and become a problem. Their appetite is enormous, and they can completely raze a garden in a few days unless stopped. They can also dig burrows under things, to the point of causing structural collapse (as they did under the gravel floor in my pole building). Trapping or killing are really the only way to deal with them (or get a large dog). You may want to check your local ordinances regarding what is allowed for ground hogs, since catch & release may be