Are you sure that you know? Are you sure that you know how to properly maintain or shoot a gun without being a liability to others around you? Just because you grew up around guns doesnt make you an expert. Id feel much better if everyone took the handgun course, id rather not have people running around with handguns that have no idea what they are doing, atleast they have gotten some kind of entry course.
Id also definitely follow the regulations and laws, a couple of fish are not worth the fines you could get.
If it helps, you can hunt moose in CT which many other states you can't.