There are like 3 different kinds of AGP slots, each with differing backwards compatibility. You should look at the little tab in the slot. They are designed to fit into slots in the cards.
the AGP 1.0 slot looks kindof like a backwards PCI slot. The 2.0 slots look the same, but backwards (that is, the little tab is near the front of the computer, like on a PCI slot).