To answer your original question, it is highly unlikely that your gun will shoot both bullets with the same POI, since that is such a drastic change in bullet weight.

I think it's good advice to find something in the middle that your gun will shoot well for both.