Offtopic, but currious what are your use cases when searching all HN and reddit comments? Im at the beggining of this path, just crawled HN, but what to do with this, still a bit cloudy.
Super good if you’re at a company or something
https://twitter.com/austingwalters/status/104189476543920128...
They also have a free API.
If you need data dumps, maybe look into Google BigQuery.