Speaking as a Muslim, the way the Indian society perceives us, we are the lowest of the lowest castes.
Muslims themselves perceive our layer as fairly flat. This is mostly because most muslims themselves have been caste refugees to a new religion(Islam) in the past. And for the better wouldn't want to go back to that history.