This will, of course, start to bite immediately on the margin.
If you have a poorly ventilated building, you're already at a disadvantage now with >400ppm outside air (higher in cities) than you would've been, say, 200 years ago with 280ppm air.
CO2 is absolutely a pollutant. Yes, plants like it, but we are not plants. It is a waste product, and too much of it affects mental performance.