That's what Postel thought. He was wrong. Allowing everything creates a brittle system because the system has to accept all the undocumented behaviour that other broken systems emit. If broken files were rejected quickly, nobody would generate them.
There's a difference between unknown extensions following a known format, and data that's simply broken (e.g. offset pointer past end of data).