Thats exactly what you'll need to do. Most bow shops will have a coffee can full of spacers and screws of various sizes. In the past, I have even had to manufacture spacers out of (brilliant really) cut down pieces of carbon arrow shafts. Trick is not breaking the shaft..... but there are plenty of spacers made specifically for what you trying to accomplish.