Yep, you are being picky. Your groups are good. The trigger will be a welcome relief.
Load work ups can be very frustrating. You can shoot many rounds without seeing the results you want. A man named Audette came up with a good method. Load your choice of powder/bullets for a particular test. Load 15 rounds total. Load the 1rst 3 rounds at the minimum listed load for your bullet/powder combination. Load the remaining 12 in equal increments to the maximum listed load.
Go past the grocery store and pick up some large white posterboard. Put a large target dot in the center. If you can, set the target at least 200 yards out. Shoot the 1rst 3 minimum loads to see were you are hitting. You want to be starting out 2" or 3" below the bullseye while aiming at the bullseye because your hits will tend to rise as you advance thru the loads. This is the time to make any corrections. Mark your 1rst hits, and number each successive hit, as often as necessary to keep track of them. If you have access to a chrono, use that too.
Keep your point of aim on the bullseye and shoot your loads, while keeping track of your hits and keeping your eye open for any signs of excessive pressure. Record your data for each test. Keep your target for each test. You will need to evaluate it later.
You are accomplishing several things here. Your shots should start to string up, as your loads increase. You will notice that some of the shots will group together, then start stringing again. The grouping indicates a sweet spot in your load, a spot for you to work on. There may be more than 1 sweet spot. You are only shooting 15 rounds, but you can tell if the bullet/powder combo has potential or not. You are also safely working up to the listed max load when you use the Audette method.
There is really a lot you can do to fine tune your loads. I would suggest you avoid CCI primers in your 7 mag. Also, I would start my O.A.L. .010" from the lands, tune your O.A.L. after you find your load.
Check out Varmint Als reloading page
There is a whole bunch of info for you there.