But when webpages die and data is accessed only by machine2machine APIs, we will no longer have this formatting for humans. Then we will need API-literate LLMs. Which means LLMs that can connect the dots between shitloads of unconnected JSONs. And if we don’t hint it for which connections are existing between that chaos of APIs, it will not be able to apply its magic. In short: we need to be able to bring JSON to vector space. And it is absolutely not meant for that, by default.