Listen conference organizers, if you actually cared about diversity in our industry and not just optics, you would find the best possible speakers regardless of their "grouping" and then get as many scholarships to people who wouldn't normally come to your conference. In other words, you are doing it backwards.
One of the great problems I, and those I work for, have is getting quality educational resources to the particular minority population I serve. My blood boils when I hear stupid crap like this because you are actively doing it wrong and worse: freezing out the people you want to help by not helping them grow and generating bad will in everyone else. We need the best experts to train and lecture people.