Josmund, That heavy a bullet will punch through an elk up to 100 yds, it might not bring him down as fast but in the proper place it will bring him down. There is an other thing which you may want to take into consideration.
Most gun bullet combinations will shoot well with more than one load quite often this will be a light load and a heavy load; it has to do with the vibration of the barrel and when it is exactly straight so if you are not comfortable with your load then just keep pushing it up and look for an other sweet spot chances are good that between 85 and 100 grains you will find one.