An arrow will sometimes 'plane' when it hits the water... but what you are seeing is refraction in action. (hey, that rhymes!)

The arrow isn't rising, but it looks as if it is because of the way water bends light. This is the same reason you need to aim low. Refraction makes the fish look like it's higher up in the water than it really is.