Lee if you did that and it didn't move, I'm sure you are fine. Certainly regular handling wouldn't cause any impact even that hard. With groups like that I think I'd be happy and let it be. I guess you could try knurling the bullet. That may give you just a smidge more, and make you feel better about it...though I think you probably have nothing to worry about. Easy loading sure beats tough loading any day.

My loads have always taken both hands to load I guess I am not sure what it takes in down loading pressure to be safe.

I would have no qualms over hunting with a load if the bullet does not move off the charge when you hold the gun out with both hands, muzzle down, and shake it for five seconds or so, and then tap it on a 2x4 the way you did.

I'm with Lee. I want no part of a real-easy-loading bullet. I don't want to struggle with it going down either. But it should produce a little pressure on the ramrod to seat. That way there's no questions asked and no 2nd thoughts during the hunt.