jd, If I were huntingan area, I would get into the tree I hunt from at least an hour before the sun comes up. I wouldn't worry too much about jumping deer that early especially if you were to sneak in. Preparation is the key to a successfull hunt.
When you wash your clothes, use an unscented detergent. There are good ones made just for hunting clothes but if you can't get any of that then use "20 mule team borax" Use a good scent free soap on you body and hair. "whitetail specialties" makes a great product. Use a cover scent on your clothes and boots. The whole idea is not to have any human odor on you.

After you get set up in your stand it could take a few hours for the deer to come back. I have had deer bedded 20 feet from a tree I put my stand in. I climbed the tree(I use a climbing stand) and dropped my arrows, so I went down and got them, then I dropped my hat, went after it, then dropped my release, and went after it. 3 deer walked away shortly afterward. 4 hours later a deer came right down the trail. So it isn't impossible to get a deer after spooking some deer.

Go ahead and try it! you will never get one if ya don't. This could be your favorite place from now on. Everyone gets a honeyhole sooner or later, sounds like you got yours!