The rubber boots with minimal/no insulation are meant for walking. Not sitting. I'm a stand hunter, and have both types of boots.
I use the rubber boots with minimal insulation for scouting in the later fall. Hiking shoes prior to that.
The LaCrosse Ice Kings are a heavy insulated boot that keep your feet warm. I walk over 2.5 miles back into public land where all motorized vehicles are banned. You just need to learn to pace yourself. That probably means leaving earlier so you have the time to go in at a slower pace.
My trek back to my stand at relaxed walk with hiking shoes/walking boots is about 45-50 minutes. With my stand boots and other gear, I take around 75 minutes. I go in early, go slow, and stay warm in the potentially cold Wisconsin gun season.