I've been in the woods about 75 yrds from a house and watched a nice buck eating grass from the yard within easy range of my truck for an hour, so yes, I would hunt where he sees the buck.
Good Luck