I guess CPUs are pretty buggy with all their caches. If only the hardware people could fix their buggy systems.
In all seriousness sometimes a cache is what you need. Inline caching is a classic example.
In all seriousness sometimes a cache is what you need. Inline caching is a classic example.
The team with the demanding service can add a cache that's appropriate for their needs, and will be motivated to do so in order to avoid hitting the rate limit (or reduce costs, which should be attributed to them).
I mean because bad code on a fast client system can cause a load higher than all other users put together. This is why half the internet is behind something like cloudflare these days. Limiting, blocking, and banning has to be baked in.