For comparison: HAProxy was able to deal with 2M requests per second on a single machine in 2021: https://www.haproxy.com/de/blog/haproxy-forwards-over-2-mill... (Disclosure: I'm a HAProxy community contributor).
For comparison: HAProxy was able to deal with 2M requests per second on a single machine in 2021: https://www.haproxy.com/de/blog/haproxy-forwards-over-2-mill... (Disclosure: I'm a HAProxy community contributor).
fortunately it's no longer 2000 and I have more than one core, and my NIC has more than one queue
generating requests is a lot less CPU intensive than parsing requests
how much CPU do I have to spend to get a pre-formed 100 byte request into the NICs queue? not much at all
(the TCP negotiation will likely be the bottleneck)
It's a lot, but at cloudflare's scale you either have the budget for a crapton of machines per point of presence (hope I'm using the term correctly) or custom hardware that can deal with this sort of thing. It's kind of their core business.