For what audience?
A HAM radio operator is very aware of the technical process going on, the proper etiquette, etc. It's pretty easy to adapt in that situation.
A random Twitch viewer has likely never thought about broadcast latency before, and has no real reason to. It's just an unintuitive experience when chat reacts to things that happened many seconds ago.
Voice chat is probably the worst because the network and software is notoriously unreliable. Is it latency, is something broken, did they just not hear me? Are we talking over each other, something that can easily happen in casual conversation vs. a radio transmission? That mental overhead is constantly there. Imagine trying to explain to your mother that she should end all her statements with "over" and confirm whenever she hears something. Are you really not sure why people find this difficult, or are you just so proud of your own technical knowledge that you've lost any kind of reasonable perspective on the issue?
Lower latency is an unambiguous improvement in every regard; of course people care about it.