Sort of depends upon the type of rifle you carry but the most shots I've ever taken in a day of deer hunting is two (wouldn't have needed the second one ... but I MISSED with the first!! [:-]) Believe that is the same day I realized that it is better to just throw the contents of your first speed-loader on the ground - calms you down a bit.
All that extra stuff packed into the woods is just something to rattle or otherwise annoy you.

But you better have some light tools and essentials within some reasonable distance (camp or vehicle), else be prepared to go home early.