It's the system which is enabling people to take advantage, and only system can fix it through changes in law!
When the system allowed segregation, whom do you blame more - the system which allowed it or the general people who were taking advantage of it.