You would want to consult reference books or google for reputable sites for lists for whichever particular critters you have in mind.
If you are specifically talking VEGGIE garden, though, you will not go too far wrong by simply avoiding all plants of the Solenaceae family (tomatoes, potatoes, peppers, eggplants) (obviously their fruits are ok, but the leaves and stems are not good to feed) as well as rhubarb leaves. Excessive amounts of dried mature legume seeds are not good either but that's unlikely to be an issue for you.
Other than that, as a general principle, if you can eat it, so can animals. This does not mean that infinite amounts of X will agree with all animals' tummies, so be sensible, but I do not know of anything in the veg garden that's poisonous to them and not to us.
Pat