I definately think that what you asked was fair. You invited them on a doe hunt and they pretty much said "if I come I'll shoot what I want." If I were you the invatation would be closed.

On the other hand if this is during the regular archery season and they have not harvested a buck, it might be difficult to get someone to come to hunt does, when they can go some where else and possibly see as many does and still have an opportunity at a buck. I personaly would decline your offer as I enjoy hunting does, but like knowing that If a trouphy went by that I could shoot it. Maybe you could invite someone that has filled their buck tag.