When I got my rifle I had a scope put on it, took the rifle sights off andplugged where they were. Could taking these sights off and plugging the holes or putting the sights back on throw off any kind of accuracy? Didn'tknow if avery small detail like this would affect my rifle or not. Sorry if this is a dumb question. Any help is appreciated.