Sounds more like you have turkeys and other little creatures eating the rye and doing the scratching. The rye would be more expensive than corn and I can't see the deer prefering it over corn. The deer may be smelling the rye or are feeding on acorns or other foods in the area.