Find another spot. No point in hunting where the deer aren't. If the deer activity picks up in your backyard, you can always head back over to hunt it. Unfortunately, we can't easily force deer to go where we want them to, so you have to move to where they are.