I find it interesting how hard it is to think of a question that truly cannot be answered by just reading lots of text. Stuff like "how can you carry water without a vessel?" (you freeze it!), which might stump a lot of AI models. But then you think... there should be texts that explain that ice is water and that ice can be carried. Similarly, the problem with numbers (lenghth, height, etc) isn't a lack of data, it's messy notation which is still easily parsed by human readers and probably could be solved.

If anything, I've become more convinced that text alone has enough information to solve some eerily specific problems. It's quite a powerful tool.