Dammed if you do and dammed if you don' t
I would have probably backed out 250-300 yards away and try to anticipate where he would end up. If it was that early maybe head towards bedding area or travel path. Either way I would know whatever I would choose would be wrong. Then I would be thankful that at least he exists and that I saw deer.