Hacker News Reader

They are actively scanning all of it, looking for interesting stuff.

How do you do DPI on hundreds of PBs a day? Explain the process that would allow you to "look for interesting stuff".

With a lot of fast ASICs and by aggressively discarding stuff you don't want. It's not magical.