Just a thought, how good are you at range estimation?

The only reason I would add pounds in your case would be if you could get more speed from your current set up. I personally like to be at a very comfortable draw weight, for me that is 70 lbs, I can hold that for over a minute if I have to and still shoot accurately. The reason I am at 70 instead of 60 is that at my draw 27 1/2" that extra 10 lbs gives me 20+ extra fps which results in a slightly flatter trajectory allowing me a tiny bit more leeway with range estimation. I would NEVER advocate for losing accuracy to gain speed! But if you can handle more speed accurately, flatter trajectory is an argument to at least consider it.