Please tell us what state and what the terrain is like.

In western Virginia and East Tennessee, it's remarkably hilly and that terrain provides much more backstop for shots on deer. It in fact is rare you get a shot in which you don't have the ground in your scope, unless you are in the bottom of a ravine looking at a deer at the top of a ridge/crest (obviously not a safe shot unless the target area has a large tree behind it). For that reason I would look on GoogleMaps and try to hike into the most rugged place I find that seems to have good deer habitat, and is farther from the road. The more effort you put into it, the less likely you are to run into other hunters.
If I hunted in a flat area, though, I'd be much more nervous about hunting public land.