I dont think you will scare them off, but you may want to re-think your strategy. IMO i think you are better off staying portable. If a deer changes its travel pattern even the slightest, your permanent stand may be in the wrong spot for a long time.