KE isn't the only thing, you also have to consider momentum as well. With that set up I would actually be looking at heavier arrows rather than lighter. At least I would. I would be looking at a 400 grn arrow and two blade cut to tip head for that light of a set up on deer. You are probably getting energy equal to a normal person shooting a recurve or long bow with that set up.

Paul