Reloading had always been of interest to me, but I felt that it looked too complicated.
Then, a few years back, I got tired of the goupings that I was getting with boxed ammo. So, I bought Lyman's Reloading Handbook.
This is a very comprehensive "How-to" book for the beginner (IMO).
It took a lot of the mystery out of reloading both rifle and handgun cartridges.
The ABC's of Reloading is an excellent follow up book. You will probably want to pick up bullet manufacture's books along the way as well. They too, have great info.
I have been reloading for just 2 years now, and I think that I enjoy the reloading as much as the shooting. And there is still tons for me to learn!
I don't think that you will be disapointed that you started, even if you "don't shoot that much." It is enjoyable, and your accuracy will improve.
Nothing like "Man-time" at the reloading bench!