In PA the accidents during deer season are generally not a hunter being mistaken for a deer. It is usually someone getting hit that was in line with the deer, or more often behind the deer and not seen. I don't think ditching the orange is a great idea. Even in a tree the woods where I hunt are so steep that half the time you are still on the level of a shooter.