if you got other hunters hunting clase by and shooting anything that they see, as well as putting pressure on a certain area, then there isnt much you can do short of finding a new place to hunt.
We are the same age and when I was younger I used to shoot does and scrub buck all the time. For about the past 7-8 years I have stopped doing this and letting does and non mature bucks walk. Since then I have started seeing bigger deer. The point being after you have done all your scouting and planted your food plots ( if you do plant them) then the only other thing to do is get in the stand early and stay late and on ocassion hunt in the middle of the day, after all of that the only other thing to do is be patient and let the trash bucks walk. This could mean going a year or two sometime where you done kill a deer, but I promise if you start letting the smaller stuff walk then you will start seeing more trophy bucks.