I have a target that is about 2x2. I RARELY miss it even at 50 yards in the wind. However, I always make sure that there is a backstop. I use a sheet of plywood. I am not as concerned with damaging an arrow as I am with it hitting something it shouldn't......
Here's how I look at it: If I shot the arrow correctly and it was that far off, I don't care if it is destroyed as it is worthless anyway.