I used (in this order) green logs, old rotted logs, branches, yard clippings, horse manure, dirt, leaves and compost. Then I heavily mulched with straw. Ideally you should build one in the early fall so it will be ready to plant in by the spring.
I started late so mine may not be ready to...