Stick with it man, I've missed deer and then got cracks at them later that day or even a few days from the original miss. Deer are stupid this time of year and you got to take advantage of them. Try not to focus too much on the rack,
once you see he is legal or a shooter, than just focus on his body and make the shot. Good Luck!