If you feel good about your decision then you made the right one. But it has to be your decision. Lots of bow hunters would look down on you for taking that 4 pointer. I would have nailed him. I have only taken one doe...ever(this season as a matter of fact) If it's a decent sized deer I would take a spike. Maybe after I get some more kills under my belt I might let im walk....I let a few does walk this year because I thought they were too small. But I'm not a big time trophey hunter. I love to hunt, and I love to eat venison ( and squirrel, and turkey).
Only you can make that decision.

David