I speak three languages on top of my own native language and never felt that way at all. In my opinion it's just a weird idea coming from people who like to overthink things.