We serve up about 2000 requests per instance per second, 8 instances on an 8 core machine with 32 G of RAM.
We serve up about 2000 requests per instance per second, 8 instances on an 8 core machine with 32 G of RAM.
So I ended up running multiple instances. I've discussed this with a few other HN'ers and we agree that it shouldn't be necessary but to date I have no solution for this.
Probably <500 cache hits per second (a large portion of the content isn't cacheable).
So I should be able to serve that from a fairly low spec machine.
One good way to test is to replay a days worth of log files.
No, it's actually for a competitor, I helped put their CDN together.
WW is only about 100K uniques per day, that site is pushing very close to 2 million now.
For ww.com I still use a very old chunk of software called 'yawwws', it takes care of the stills in the index and the index pages themselves. Hopefully we'll be able to phase it out soon for a Yii/memcached/varnish driven combo.