By the sound of it I'm going to go out on a limb here and say that another reason your peep may be too high is that your bow's drawlength is several inches too long. You said you anchor below the ear and slightly back, which means you are probably way over extended.

Another rule of thumb is that when you come to anchor with an arrow on the stringthe arrow's nock should be back no farther than the corner of your mouth.