Seen this same "problem", its not the worst problem in the world to have but I see your point. Set the feeder earlier, it's ok if it goes off before 7am, deer are up that early set it for 6 or 6:30, they will be there.
I feed less in the evenings anyway but thats just my own personal method. Also, turkeys will "spook" when they see movement and wont come back to that area but deer will, usually. So, if you have to go out there and scare them off of the feeder, it isnt the worst thing in the world to do....also.......slingshot...just sayin'.