Hey VA....that is the way to do it! You will get one eventually...your patience and persistence will be rewarded.
What you described IMO, is the maturing of a hunter. The bottom line is, if it won't make you happy, don't shoot it. It really doesn't matter what others think or say, hunting is an individual thing. I applaud you for doing what you are. I personally have not shot a buck with my bow since '97, because I gave up shooting the small & medium bucks.I don't regret it a bit. I have shot alot of does, and passed so many small bucks I can't even count them anymore. I am always looking forthe big one. Unfortunately where I hunt, the big ones are much fewer and farther between than other areas. But hey, that is ok, I still stick to my goals...because that is what will make me happy. I would rather shoot a doe any day than a small buck.
Good luck, you'll get him
PS: My office is in old town manassas, so I am right down the road from you,almost daily