It's your land and you have every right to lease the land if you want to. I've been part of groups for a long time that leases land (mostly timber company land). I spend about $3000 a year to make sure I have a good place for myself and my grandsonsto hunt and don't have any regrets.
I was approached this year about being part of a outfitter arranged lease based in Missouri. The first year you pay $1500 and then each year threafter you pay $1250 with a guarantee of having a certain number of farms to choose to hunt available each weekend. No hunting during the week on any of the land. Mileage is the only reason I didn't join.