Generally when people are talking about pollutants they're talking about man made pollutants.
You can include smoke in air pollution numbers, while not considering wild fires to be pollution.
Coal and oil are also a "natural" fuels, but we burn those too and we say it's man made pollution.