I also agree family is #1. I'm heading down the same road as you are. I've got a little monster
and he'll be two on the 10th and I have another little boy due on 11/29. I try and sneek a hunt hear and there when I can. Ofter I only get out for an hour and a half at a time but I still see deer. If your hunting time is limited I'd try and hunt the most productive hours. This may mean you take an evening a wekk and hit the woods for the last 2-3 hours of the day.
On the bright side when the boys get a bit older hopefully they'll be interested in hunting with dad. I believe if you instill a love for wilderness in them at a young age they'll take it with them their entire life. I know that's how it was for me.
Do you have the option to take your vacation time in samll 2 hour chunks? luckily I can and I use it to my advantage. I believe I get more out of bagging early 2 hours a day for 4 days then I get taking the entire day off(except durring the rut).