I would pass. I have had my opportunity at a giant my first year bowhunting would have netted over 220 absolute giant. The reason I passed was the fact I wasn't comfortable shooting the distance he was at especially with how bad I was shaking with buck fever... Needless to say I haven't seen him again and nor will I ever. I had passed up many deer 150+ before I even shot my first buck because they were to young. I don't care about antler size though more about the age, antlers are a bonus.
I like to put it this way people are more sad and upset when a child dies than when an older person does due to the simple fact the child never got to live. Why not let the young dumb bucks grow and enjoy life and go after the old wise deer that can are the true trophy