Welcome to the addiction that is bowhunting.
You should be able to hold your bow in front of you, pointing at the animal, and draw straight back. This minimizes the amount of movement seen by the deer. As said draw when the deer's attention is elsewhere. Good luck.