Mountainman, adjusting wedge fit is and easy fix and certainly not a gunsmith job. Lay the wedge on a hard surface supported by two nails - one under each end of the wedge so the wedge forms a bridge from one nail to the other. Tap the center of the wedge with a hammer to create a slight bend. Try it in the gun with the bend up, and with the bend down. If the tension is not to you liking, increase the bend (or decrease it if necessary). Wedge fit will definitely have an effect on point of impact. So the sights may need to be adjusted once you get the wedge the way you want it.

If I understand the sight issue correctly (still shooting high with the rear sight at its lowest adjustment?) you will need a higher front sight. But take care of the wedge issue first. A tight wedge just might move the POI down.

By the way, I've requested this post be moved from the Reference Forum to the regular Black Powder forum. You'll get more action there.