Very soon that leads to any speech criticizing, say, the capitalists or the politicians in power.
No, because that's not an intrinsic property.
Hating people who take too long at the register isn't the same as viewing all redheads as inferior.
Free speech is so critical to a functioning free society that I'd rather err on the side of allowing bad speech rather than banning not-bad speech by mistake.