Where does your gun hit at 100? If you are zeroed for 100, aim dead on at any distance from 0 to 100.

Even if you were a couple inches high at 100, you could aim dead on at 20. You might be say 2-3 inches high at 50 or 75 though. Nothing to worry about if you shoot for the middle of the deer, top to bottom.