ive done the same thing only i realized it was a button buck. I felt pretty bad about that but then i donated it to sportsman against hunger, i felt better knowing the meat was going to good use.
I learned one good way to judge size is by looking at the ears, if they look to big for the deers head then its probably small.