Hacker News Reader

Parent Full thread

misterman0

Thanks!

1. You may submit a page. When I have a little more capacity that just 1 CPU/1 GB RAM I will also crawl.

2. I'll look into it. Thank you.

View on HN

Altavista ran on an AlphaServer 8400¹: maximum 14 × 612MHz CPUs, 28G RAM.

¹ https://en.wikipedia.org/wiki/AlphaServer#Turbolaser_Family

Would the common crawl dataset be useful to you starting out?

http://commoncrawl.org

Yes absolutely. I have been holding off crawling because I have no server capacity yet. That will probably sort itself out pretty soon from the looks of it. When I have the disk space I'll start using their data.

Reply on news.ycombinator.com