Could it be, the reason you don't like eating deer is because you normally kill bucks, and that is the taste you are used to. Usually a doe tastes much more better than a buck does.

My lady can instantly tell when the meat she is eating is a buck. Most of the time it surprises me when she wrinkles her nose, because the meat tastes good to me. Upon checking the meat, i have always found she is correct, and she does it without fail. I no longer shoot bucks for our freezer just to keep her happy.