There are ways to speed things up dramatically. Index build just became multithreaded (see above).
We have ideas on what to do with ingest.
Also do you interest from S3 ?
Reply on news.ycombinator.com