If he's a biggun and mature he didn't get that way by letting someone just walk up to him. Most likely he'll know your in the woods before you do.

Maybe he's a secret agent in disguise and he's casing you out LOL

Good luck in your quest, I'd say "GO FOR IT" I see nothing wrong, its not like you bought the buck at an auction and tied it up. If its wild, and you have permission to hunt the place its open game.