Unlikely that you scared them off for good. Is this a fixed stand or a tree you use a climber? Could you move easy enough 20 yards one way or another? Field, woods, situation?