How do you guys find the same deer the next year? Do you just go to the aisle marked "deer I passed up last year" and they'll all right there?

If you pass him up, you may never see him again. Even if he stays on the property, he may go nocturnal, weather might be different next year, rut might lead him other places, food might be different, etc....

Unless he's on a leash, in a pen, or you feed and bait, that deer may only give you one glimpse of him in his and your lifetime. Shoot him if you see him......unless he's too small for you.