Generally you wont be able to figure the caste of someone but there are clues like skin color, fairer skin generally is "upper" caste, sometimes your surname also gives away your caste.
Unfortunately some Indians specially from the "upper"caste take this very seriously and think they are superior compared to other Indians.