The biggest drawback for me in shooting a crossbow is trying to shoot behind yourself in a tree stand. I think it cuts your effective shooting radius by at least 15%.
I've already smacked a limb on a tree when I was SURE I had clearance and missed as a result.