I agree, just put a black on on there, also then if you ever put it on another rifle it'll look fine, or if you ever go to sell it, I think it would be easier to get rid of a black scope than a silver one.
I don't think a black scope looks bad on a stainless barrel anyway.