I do that identical thing on my farm consistently. Things you have to do though is be able to slip into your stand completely silently and undetected. The deer can be and often will be up and moving by then so you have to be very careful. The second thing is to glass the area and move in slowly. If there are deer around your stand just go home or go somewhere else. The worst thing you could do now is spook them. As long as they don't know they are being hunted they will stick around. Once you spook them they will be nervous in that area for a long time. Also, once you are in the stand get ready as quick as possible. One could come in at any moment that late in the evening. Good luck!