That is an "old school" philosophy that you see a lot. Best way to deal with it is try and "educate" people that think that way on the benefits of shooting doe.
I know several people in the same situation, where they were taught by their fathers and are set in their fathers ways. Not necessarily a bad thing, but sometimes change is needed. Tough to go against the "old man" though. Trust me, I know.
Hunting in NY, the one thing I can't stand is people that apply for doe permits and do not(on purpose)/will not use them. That just takes away from those that will take doe.

ps - you said you signed over your permits - you hunt in NY? The sign over of permits is new to NY and I really like the rule