If I am reading your post correctly it just sounds like one of your limbs is backed out of the limb pocket a bit more than the other. This could be because someone attempted to tiller tune it at one point or it could just be that someone didn't back the limb bolts out an even number of turns when the draw weight was originally set.

Driftrider gave you good advice. Take it to the local shop and have them give it a tune-up and the once over. Prices typically average between $10 and $35 here locally.