Depends on the mask. A good one is only really noticeable as something on your face. I find it easier to breath as the air feels cleaner and my chest feels less tight.

PS: I suspect re-breathing a tiny amount of CO2 probably has a measurable impact over a longer race. (Don't have data on this though.)