Qucik newbe question. Why does moving my sight up cause the arrow to go down?

I just spent a lot of time moving my sight down to correct a high arrow at 20 yds, and after completely missing the target and hitting a fence, I decided to go 180 and move the sight up. Now, I am right on the target.

Thanks.