I never had a problem. All the bolts I've seen have the S/N or the last few digets of the S/N marked on the bolt.I store most of my rifles without the bolts in them.. I wipe the boltdown ,then seal them in Freezer bags. Each bag has a number. I made a list showing what number that bolt goes to.
At one time i had over 50 bolt action rifles, many of them Remingtons, i'd take 10 or 15 (or more) to the range, and i'm sure i'd have had a "huge" amount of fun getting the right bolts for the right actions, serial number or not!! And i had plenty that weren't bolt action to deal with too.
Many times i was at the range 3 or 4 days out of the week especially when it was getting toward the fall hunting season or a match was comeing up.
Anyway, what ever works for you is "ok" with me!! :>
Drilling Man