If your not going to be able to remove the inserts why should it matter what they are held with as long as it's strong enough...why not JB liquid steel?
I epoxyed mine in - never going to remove them .... uh, until I decided to try some 100gr brass inserts to bump my FOC and I Dremel tooled 1/2 dozen last night, 4 came out with only cutting 1/2" of shaft off, the other 2 I don't have any idea how I'm going to get them out - might not and that my friend is a good reason to not do it !