I think for a lot of them, it comes from fear - if you don't speak the language as fluently as natives, or with a noticeable accent, you are very often aware of it, and sometimes reminded explicitly.

Some parents are probably just trying to shield their children from what they see as a handicap, or a source of embarrassment. They're wrong, but their motivations are understandable.