Sounds like You are getting smarter by patterning the Buck when he comes in...now You just need to get in there scent-free and quietly so You can harvest that Big Buck!
Maybe You need to set off a little ways away from your existing stand so he doesn't know your in there hunting him?