Sure looks like Skunk Cabbage to me but personally I have never wandered close enough to have a good look. Many moons ago it has been said it to be a prized garden plant in England.
One of our most admired garden mentors said when he first immigrated here from England and saw his first stand of skunk cabbage he thought he'd died and gone to heaven. We almost fell over laughing and so did he.
http://wildflowerfinder.org.uk/Flowers/S/SkunkCabbage(American)/SkunkCabbage(American).htm
Cover over in plastic and wait a few months before removing is said to be one way of getting rid of it, another way is putting on gloves and cut the stems and immediately paint the cut end with roundup.
Gloves on, pull and dig but be very careful of where you dispose of it, this is how it was so spread around over there. I believe it's on your invasive list and yes it is poisonous and can give skin irritations.
Annette