I don't think it would hurt your hunt.
Now I'm in the same situation. I have some new private land to hunt and one of my hunting partners wants to put down minerals. I don't think we need to. Its the only bush for miles around and the deer USE it to its full extent. I don't want anything changed.