Like others said if you can hold 1" groups at 150 then 180 isn't much of a stretch...Look up deer vitals online and it will help you knowing where to aim on a head on shot.
This is something you should know anyway. Some people think they are aiming right and aren't hitting vitals or not heart lung area even when a deer is broadside.

A gun with the right amount of energy will drop a deer in its tracks at 180 yards. But you should also be prepared to track him if he runs off. At that distance even head on make sure he is still. The last thing you want is him taking a sidestep and your bullet striking him wrong...If he is head up looking your way standing there I would center the chest and squeeze a round off. I'd guess he'd be laying there when you walk up....

Oh and when that happens....post up some pics!