As an Indian immigrant I had noticed this very early on too. It made me very uncomfortable when some of us would crack jokes in non-English language while there were others around who didn't understand the language. After first few years I stopped working for companies that had mostly Indians in IT. I must say I have been lucky since then to always find a good mix of diverse backgrounds in my team that it has not been a problem.