Yup. Changing the POWER on your scope should have ZERO impact on your POI if your POA is precisely the same. The distance of the target will impact POI, but for most deer calibers, this will be negligible from 0 - 150 yards if you're zeroed at 100.

As mentioned above, keep that scope on it's lowest power (unless your stand site dictates otherwise and you are expecting to see your game at longer distances). If you need mire power, chances are you'll have more time to add it than you will to dial down.