Marvel at the feat of operations, not the engineering. The techniques used to process this information over the years have mostly been quite banal. Look behind the scenes and much of it is just batch processes written in old school languages (Perl, Java, even C) reading text files from one folder, filtering or enhancing them, and writing them out to another. I once taught a PM how to use a Perl hash to do a join instead of nested for loops and she spent the next year feeling godlike because she could do this stuff in O(n) instead of O(n^2).