Some people will think you are crazy for using a bow during rifle season. I did some last year and you should have seen some of the looks on peoples' faces. They were SHOCKED to say the least. This year I don't plan on ever picking up a gun.
I think you should go for it. Besides, I feel bowhunters are at an advantage during rifle season anyway. We usually don't care to have our stands so we can see for hundreds of yards. Personally, I tend to stay in the thick stuff and that may very well be where the deer go when they get pressured, right in my lap.
Either way, good luck!