For me, getting more speed is okay, but I always ask the question, "What did the manufacturer do to give me more speed?"
If they reduced the brace height, gave me more reflex, or made the draw force curve steeper, then I don't necessarily want it. If the reason was a more efficient design, leaving me with a bow that is as forgiving as I had in the past, then I'll take the speed without complaining in most cases.
Man isn't that the truth! If speed increase doesn't come from efficiency improvement then there is a price to be paid for it. I think a lot of archers only look at peak weight and assume that if 1 70# bow shoots faster than another 70# bow than the faster bow is better and it will be just as easy to shoot.