With having to agree with RR, Wayspr, and Homers Brother, there are many of us who shoot weapons with great accuracy results due to knowing how both the loads and the weapon handle to both our and its fullest potential.
With that being said, I would just say that if you are only able to get upto 2" groups at 100yds at the weapons best with that particular load, I would try several other loads and brands. BUT, stay with loads that you know you will be using for hunting the game you are after. Don't use a lighter load just because they shoot great but will not have sufficient energy or penetration to cleanly harvest the game. Match your load to the game.
Other thing, KNOW YOUR SHOOTING CAPABILITIES AND LIMITATIONS!!!!! Just because you saw someone do it on TV with what looked like your weapon, don't think that you can also. Spend the time on the bench and hunt both safe and happy!!!!