Thanks for your work.
How did you deal with the Flash content? Decompile the source code? Did you encounter tabular PDF data? If so, did you find a good solution?
Also, have you or your colleagues had any contact with the Wolfram Alpha team? It seems like your organizations have similar data curation goals.
http://blog.stephenwolfram.com/2010/10/the-emerging-computat...