Although you never need a reason to buy another rifle, there is noting wrong with your bolt action. I'd opt for a nice pair of binos. You don't have to break your wallet either. A pair of Nikon 10x42 or 10x25 would be perfect. I use the 10x25s for archery hunting. And when combined with a Crooked River or similar harness they are easy to tote around.
The scoped bolt action would allow you to take those occasional long shots you may encounter or slip a bullet through a hole in the brush much more accurately than an open sighted lever action. If you're still hunting slowly enough with the wind in your face you will have a shot at an unalert animal.
That being said, I have 4 lever guns that I occasionally grab for the deer woods. But these are, like you stated, fun guns.