In Maine only hunters have to wear orange, but you can bet your boots that you will see everyone wearing it, just because!!
Walkers, joggers, hikers and yes, even horses in pastures!!
It is quite hard to make yourself except it, but it will pay off in the long run with reduced accidents and a good show of faith by contributing to the cause.
That can only benefit the outlook towards hunters.