Actually, I have found a trick. If the antler looks like it was forced off. Walk the trails back from where you think the buck was coming from. If it looks as if it fell off, walk the trails to where you think the buck was heading.

This especially works good for antlers with some size to them. Smaller racked deer may carry their single antlers for some time due to the lack of weight on their heads.