Wouldn't the feeder be considered baiting anywhere? I mean, you buy a feeder for one reason!
I'm not against having feeders at all, but having one does NOT guarantee that the deer will respond at exactly the time YOU want.
Maybe when you set up to take a deer, the way you entered spooked them? Do you know where they are beddown at night? Try a different way of entering tohunt.