Is number of germs really an accurate measure of how dangerous/infectious/dirty something is?

I feel like this is a (slightly less egregious) version of like "cigarettes have X hundred chemicals in them, therefore you will die!" when in reality it only takes one chemical to kill you, and many normal food products have roughly as many 'chemicals'.