That deer probably won't even be on your property once it sheds its velvet and splits up from any bachelor group it was in. I wouldn't worry about it, think of how many times you have spoked deer walking to your stand.