Are you one of those Americans who think any expression of e.g. White/Southern pride is a sign of KKK racism? I mean it could be but some people just enjoy being Southern.
"Caste System" in India is like "Patriarchy" or "Structural Racism" in the West. Some people are very invested in the idea. Some think it is one of several factors. Some argue it is an invalid concept and some just say la la I'm not listening.