I suggest You do some Scouting now in the off-season and find You a better area off from where the disrespectful Hunter was at!If You take up Bow Hunting it will give You more chances to be out in the woods when most Gun Hunters won't be there!You did the right thing by not starting a fight or arguing and escalating the situation!
I would also try finding some Public Ground to Hunt or even join a Lease so You can Hunt in peace!