Deer aren't big fans of cattle (or so I've been told) and they do compete for resources (like with hogs).

So I would rather hunt an area that doesn't have cattle, but it's not like they are going to drive the deer
off the place, it just might lower the population and your sightings some.