RE: What would you do?
I'd be putting a bit of meat in my freezer with the doe tag. IMO if you've got it, use it. As for the buck tag, I personally am commited to taking mature animals. I've passed a few smaller bucks this season and have seen two nice IMO shooters that just haven't given me an opportunity at a shot. This works for me but may not be what you have in mind. If you're content shooting any buck or your standards say 6 point or 8 point or better then tag the buck you're happy with.
If I were on your property and new of two monsters roaming the area I'd be looking forward to some late season hunting. IMO late season is a great time to score. Hunt the food scorces and get the deer as they settle down from rifle or shotgun season. Bucks this time of year will have two things on their minds. Food and second esterous does with a emphasis on food.