I've long thought about doing this with arXiv to determine if you could extract results and synthesize answers to questions. Is anything like that part of the goals for The ContentMine?
Yes. We're trying to build the toolset so that the end product is not predetermined, but that we empower people to make whatever they can imagine. In about 6 months time it should be relatively easy to implement your idea on top of what we build. arXiv will of course be included :)