I did some research on waterfowl in Idaho who have ingested lead pellets and I can tell you that these is a chronic build up effect. The ducks with many lead pellets in their crops were in terrible condition with atrophied muscles and much reduced weight.

But I doubt you could incidentally ingest enough lead to really make a difference in your health.