One of two things are probably happening.
1. He is circling these locations wind checking before he comes in. In that case move down wind and catch him wind checking the scrapes/location not at the scrape/location.
2. You are overthinking it,its just chance, and you need to stick with the stand with the best wind.
Just to simplify what am i gonna do if i have a buck visiting 3 different scrapes every 3 days? I'm going to pick the easiest one to hunt,hunt it for 3 days straight, and kill him when he shows up.