Hacker News Reader

we all have experienced this somehow, how do you handle ensuring the accuracy of the data?

we are monitoring around a million companies and all their jobs. the process is almost at a daily basis.