Hacker News Reader

HNHacker News

Top New Best Ask Show Jobs

Comment by denkquer | Hacker News Reader

Parent Full thread

denkquer·

there is no way on earth pypi traffic is higher than wikipedias.

View on HN

https://dtdg.co/pypi

pypi servers receive 1 million requests per minute. That's likely more than wikipedia.

Back-of-the-envelope math says Wikipedia serves at least twice as much traffic.

According to Wikipedia's public statistics[0], they receive ~3 Billion media requests per day, which is about 2 million requests per minute.

https://stats.wikimedia.org/#/all-projects/content/total-med...

https://pageviews.toolforge.org/siteviews/?platform=all-acce...

en.wikipedia.org has around 260 million page views per day. Each page view consists of multiple HTTP requests (picking a few random pages shows twenty or more per page) - so I'm pretty sure that wikipedia has higher traffic figures.

Both wikipedia and pypi requests are >99% readonly and cacheable, and neither have strict global consistency guarantees. That makes them very cheap and technically easy to run through a free global CDN like cloudflare.

You make it sound like Cloudflare would be OK serving all Wikipedia or pypi traffic for free. Reality would be a little different.

https://www.cloudflare.com/case-studies/wikimedia-foundation :)

Fastly currently serves all of PyPI's CDN traffic for free. Cloudflare probably would as well.

It seems wikipedia english gets 255m per day. This doesn't include all of their image hosting and other side services though. I think those are in the many hundreda of millions if not billions. Id say they are at least comparable.

It's kinda moot though. I wouldn't begrudge pypi asking for money either.

Reply on news.ycombinator.com