It will not spook that buck, or any others. While the scent is still strong, it may attract them while you aren't around. After a little while, the scent will fade, with no harm done.

Don't worry about it. Not a big deal.

MOCraig