Friend or not, he had no business touching your rifle without your permission. If it were me I would have had a few words for him. You use the reference mark on your ramrod only for correct seating depth. Too deep compresses the powder which would affect accuracy and banging the rod down on bullet/ball damages it also affecting accuracy. Not deep enough and you have a potentially dangerous situation where the projectile is not seated over the charge and actually acting as a bore obstruction.
Your friend deserves a good swift kick.