Keep doing it if it's working for you. I'm not really aware of my hand moving back, although it apparently moves far enough to brush my ear. For me, the exaggerated hand movement, like I see in some shooters,tends to make it hard to keep the sight pin on the target as the arrow is flying through the air. The sight pin wants to go right no matter what I do. The more subtle follow through allows me to keep the pin steady.