Example: you know what would be harder than anything we're talking about here? Quadrupling the performance of the best compression algorithms. It's hard. In fact, maybe there's some information theory that even says it's mathematically impossible. That makes it really hard, which makes it what all of us should immediately start working on.
The author writes elsewhere that you also have to have an edge, but that's frequently omitted from this "hardest thing" advice.