I’m French, this is definitely not an urban legend, for some unknown reason « wrongly » spoken French sounds especially grating to me and all the other French people I know. We might not say it to your face , but it is extremely hard to ignore.
I wonder if it’s the same with other Latin languages, or if it is just some consequence of years of forced standardisation of the French accent.