Just out of curiosity, what's the hardest data set in the world?
I was originally talking about trying to get currently profitable trading strategies out of the same pieces of accounting information that millions of smart competitors have access to. It's definitely a bit of a Red Queen's race ( http://en.wikipedia.org/wiki/Red_Queens_race ) trying to find and clean up new data sources and improve our trading methods well enough just to stay current. It's also hard because even though there's lots of data available, it's hard to tell how useful the early data is and whether you can still make money with trading strategies based on it.
Btw, The wikipedia link should be http://en.wikipedia.org/wiki/Red_Queens_race