I agree...let the smaller one's walk and one day a Monster will walk in and You'll be ready for him!
Do You have any Food lots or Crops Feilds nearby,have You put out any mineral licks...stay as scent-free as possible when Hunting,the Deer/Bucks may know You are there and are staying away...there's lots of different things You can and shouldn't do that will better Your odds of getting a nice Buck.Set up a few trail camera's to see whats moving around,hunt the wind more and keep at it...sooner or later everything will come together for You!