I have a deer herd of Nine that come through my yard at around 5:30 every PM and my two cats have been ran out of the garden by does several times and seen by a few other than myself doing this. There is something to really watch for if you have a male cat in the house, if he smells any sent from your hunting clothes other than pine or dirt he will spray your hunting closet and sometimes you may not be able to smell it yourself but its there. With that in mind, a good mature buck is going to avoid any territorial predator markers, cats included, he just want chance it.