The problem with lead (and presumably other heavy metals) is that exposure is cumulative as it gets accumulated in your body so there really isn't a safe amount.
While that's true (we should generally avoid ingesting lead).. Lead also gets excreted reasonably quickly.
In other words it's not a reason to avoid a few occasional pinches of cumin.