RE: He's playing with me!
Here's an idea for you that might help you bag him...
You said he is making a lot of scrapes and rubs. Make a mach scrape or scrapes with a stick and put some scent on it. Keep doing this persistently. When the buck your hunting finds out another buck is visiting his area, he will change his patterns to intercept it...especially if the buck your hunting is the boss. A good additive is also a buck decoy.
This worked for me a few years ago when I had the same thing happening to me. I then read the above idea either in Field and Stream or Bowhunting Magazine. I put the idea to test and low and behold nine days after I made my first mach scrape, the buck I was hunting stepped out about 20 mins before dark. He came in stiff legged and hair standing straight up on his back. He made a "B" line for my decoy.
Good Luck and hope this helps!