It's the seeds! in the Poke Weed that are lethal. They're a neurotoxin. The juice from the berries is actually used successfully in herbal medicine, but you should never take it yourself without supervision.
I did read that you can freeze the berries and take them that way because the seeds...