I have hunted as deep as possible on Powhatan WMA, and even on weekdays I have run into other hunters. Though I agree that most want to stay closer.
ButchA - Hunting in that Nat'l Forests is awesome, but only worth it to me if I am camping out. Also, the prospect of dragging a deer through that terrain isn't so appealing!