Our entire civilization runs on your "polite lie" of owning non-physical things. Patents, copyrights, trade secrets, licensing agreements, NDAs. Trillion dollar companies are built on the legal enforceability of intellectual property. The software you're using to type this comment exists because someone owns the code.
Calling information "entropy" doesn't make contract law disappear. We decided collectively that people and institutions can own ideas, and we built the modern economy on that decision. You can argue that's a fiction, but it's a fiction that everything around you depends on.
You can't invoke "universal laws of information" to dismiss public claims to training data while the companies training on it aggressively enforce their own IP. They patent their architectures. They copyright their outputs. They sue competitors for misuse. They clearly believe in ownership of non-physical objects when it benefits them.
You don't get it both ways.