RE: Bigger is better......
A 1 1/2" group at 100 yards is "Minute of Elk" in my groups book. Some guys want tighter, but if you triple that which is what in my opinion you have to do to factor hunting conditions, a 4 1/2" group in the field is not bad. It's the guys shooting 3" groups from the bench at 100 yards that hunting conditions can really throw off.
Not knowing how good of a shot you are, 1 1/2" may be the best "you" can doand not the rifle. No knock, only you know, but if you were in my group I'd feel confident the tracking job wouldn't be to rough with you.