Dixie if you want to drop the deer quickly then I would use something lighter. The lower velocity of the 220 will actually reduce the size of the wound path compared to a lighter faster bullet of similar construction.
The 220 grain Sierra round nose will perform extremely well at 06 velocities and penetrate, expand, and retain weight very well to 200 + yards. The point blank range on the 220 grain bullet will actually be over 200 yards so trajectory is not an issue at 100 yards for sure.
As long as you do not hit any large bones the slower 220 will limit meat damage due to bloot shot meat while providing reliable kills.
If you are not recoil shy I would say go for it.