People from higher castes, even if they're open-minded on the topic of caste, likely have relatives who aren't -- especially if they're the only member of a large family who has left India. Children have been disowned or even murdered by their relatives for marrying a member of a lower caste; it's really hard to escape that sort of prejudice.
Not discounting your experience, but I couldn’t imagine that Sorrento Valley would have larger issues about it than Silicon Valley.
We are already so far away from home, atleast we can look out for each other.
I'm not in tech so I've never lived anywhere with many Indians. I'm guessing these types of issues start to crop up when you have higher chances of meeting many people in your exact social group back in India and end up forming cliques.