I think the answer to that lies in HTTP discovery protocols. I'm imagining self-organizing applications based on the need of the user, wiring together representations of disparate data sources into a cohesive interface.
You shouldn't have to be a dev to take advantage of the API universe. You'll just need tools that are able to reason about the data available.