Not sure how he busted me,
Did you get caught moving? Maybe turning your head to quick? Deer notice that.
I wear a face mask for that reason. You still have to be very slow, and sweep your eyes, but it does keep the deer from suddenly seeing a big round disk, which happens to be a predators facial profile.
Which tree would you use.
It's a little hard for me to visualize the place your in, but be downwind from where the deer are going. If you can't get downwind, quarter the wind. If you have to cross a path, do it early to let your scent dissipate. cover scents can help. it's best if you can avoid this altogether.
Consider a getting into a downed tree or whipping up a quick blind to get yourself in a good position. it can be as simple as a piece of camo cloth. i have half of an old army pup tent with a couple of poles for this. you might have to let things sit for a day or two if you set something up, but it can be done.
You can rig up a brush pile as well. It doesn't have to be much, just enough to break up your shape. Since your hunting with a bow, you have the issue of drawing while on the ground and it makes it more difficult. you can help yourself by using the cover. Draw when the deer pops behind a tree, or when it puts its head down. Keep an eye on its tail. A deer will often flick it when it's about to look up.