Hacker News Reader

AI-as-extreme-compression seems like a subfield with a lot of fascinating applications. Kinda like how MP3 used a perceptual model to define what sounds were least important, AI compression could have a conceptual model of what features were least important

View on HN

I think I've commented on this in the past here. Once you accept non-lossless compression, there's always a trade-off between compression efficiency and fidelity to the original. We're not yet to the point where ET can be compressed as, "a movie about an innocent alien stranded on Earth who gets help from some kids to contact his people for rescue," but we're not too far away from it, either.

You can already do this with existing large language models, as long as the entire script can fit into their context vector layer.

still wrong; can't best information theory yet.

If you want to squeeze it into one sentence, obviously it will be lossy. That's the whole point of summarization.

Reply on news.ycombinator.com