RE: keep passing?
Personally, I wouldn't shoot. I'm in a similar situation you are, this is my 2nd year bow hunting, though I've yet to shoot at a deer. I've seen a couple decent bucks on my trail camera as well as some little forks and 6's. I've already told myself that if I see the little ones come by that I'll watch them walk away, too. Atleast if you let him walk, you know there would be a chance for him to get bigger...if you shoot him, he'll be a fork forever...
Either way, its all up to what you want to do, who knows...maybe one of the good bucks you said about will give you a shot! Good Luck