"What would happen to ammo prices if we all the sudden stopped buying, or even bought rational amounts? They'd come down dramatically."

This is the key. The dealers will charge whatever the market will pay......