Meaning what you’ve pointed out is clear; the problem was the statement and not material discrimination. “No blacks allowed”, in America at least, was no idle threat.