If you can eliminate any mechanical problems, most likely you are torquing your bow. Especially probable if the grip on your bow is an older full and large grip, as Art has pointed out.

http://www.merlin-bows.co.uk/tec%20talk%20torque.htm