Stick to it. Whether you see more deer or not - or bigger ones - you'll be a lot healthier and better able to hunt longer. You'll have more wind to drag 'em out, too.
Hang in there!