Well I find it that most of the time the winds tend to be out of the west/southwest in my area. Because of this most of my stands are facing the west downwind of my shooting lanes and into the setting sun. It really does't bother me though as I hunt mostly forest and the sun dosen't come into play too much.

As far as deer looking into the sun, I don't think it bothers them at all, I have yet to see a deer squint when looking into the sun.