What's wrong with that? As long as it's legal. I don't know about anywhere else, but here in Louisiana the rule is .22 cal center-fire or larger. Go here http://www.wlf.state.la.us/hunting/regulations/ and download the pdf file then look at the bottom of page 11.

" It is illegal to hunt or shoot deer with firearms smaller than .22 caliber center-fire or a shotgun loaded with anything other than buckshot or rifled slug. Handguns may be used for hunting."