Hey oddsmell, I had a very similar hunt today! I didn't hunt this morning because it was raining early, so I slept in. But it cleared up at noon and I went in at 1:30PM, set a trail cam near a scrape that's been getting hit fairly regularly,then went to my stand. I didn't see any deer, but I saw my good luck ground hog and then just as I was about to leave around 6:10 PM, I caught a slight movement and thought I saw antler!
Sure enough I spotted a nice little 6 point with perfect symetry not 10yrds behind me and to my right. He stopped to get a drink at the little creek and walked right past my stand. He took the exact route that I took getting to my stand. He looked up, and he thought something wasn't right in that tree, but resumed walking past.
He would have been easy picking but like you said, it's too early in the season to take one his size. I've already seen bigger and the rut is yet to come! I had a great day!!! The butcher just called and said I can come and pick my deer meat from that doe I recovered on Sunday.