Hacker News Reader

It sounds like you're talking about information entropy which to my understanding is analogue to but not the same as entropy in physics?

It pretty much is the same, except that entropy in physics usually has a constant in front of it.