Are you resighting in your field points after each movement you make?
I know it's a pain but zero in your FP's after each movement of rest or nocking point then shoot the BH's.
The POI of the FP's wont be that much but the BH's POI will be and you will get a better idea of whats going on.
You are better off with a slightly stiff spine when using BH's.