This sounds to me like you are picking your head up to look at the target as soon as you pull the trigger.

If not hold at the top of the plywood,if your bullet is unstabel or tumbling it will show on impact.