But the energy of the recoil is not equal to the energy of the bullet out of the barrel due to the weight of the rifle. So the action and the reaction in this case seem very different.

But if I hels a 8lb peice of metal in front of the barrel and my friend fired an 8lb rifle, the hit I take would be the same as the recoil my friend takes??