I think your fine. Now if you were contunially pushing him out of the area he will move, but one time i dont think will hurt anything.