Language Entropy

Sounds like someone is interested in some classic Shannon.

Prediction and Entropy of Printed English, Shannon 1951 https://www.princeton.edu/~wbialek/rome/refs/shannon_51.pdf

I subscribe to the notion of entropy in language increasing, but in opposition to the author I believe it is the result of reduced complexity, as words are redefined and reappropriated, meaning and nuance are lost, precision is lost, language starts to aggregate and density declines.

The author conflates "abstract words" with obscurity, implying reduced understanding, but the importance of this is knowability - even if the word is abstract the concept can be discerned (although may require a dictionary and thesaurus), when we move away from diverse, abstract, or obscure words separated from the closely related synonymous we make the conveyed and intended meaning of the sentence in which it is used much harder to know, and no external reference could enlighten us.

This seems like a new definition of entropy unrelated to existing notions of entropy relevant to language. I'm not sure I buy "entropy = 1/abstractness"...