I'd be the last to say you can't! In fact, I never would. Heck, I shoot most often without any sights at all and get good groups. Many guys with sights can't shoot as well as I do without.

But it takes practice and a good bit of it to get there. That's the point I'm making. When you are used to shooting with a peep, you don't just take it off and immediately start shooting great without it. It takes a good bit of practice to get there and be consistent. It's too close to hunting season to get that much practice.