I don't know about this bullet rising thing. Yes, it is getting higher off the ground, but that is because the tangent the rifle was fired is "Upward".

No bullet rises after leaving the barrel.

All bullets immediately start falling to the ground at the force and speed of gravity the instant they leave the barrel.