That is the problem. I believe web is long overdue for a torrent like model where hosting is shared among all users (and ISPs instead of 'cloudflares').
Opera Unite. The idea was that hosting HTML should be as simple as browsing it.
Marginal cost of serving a text document is ~0.
Marginal cost of serving a text document repeatedly to hordes of reckless scrapers hiding behind residential proxies is ⋙0.
That is the problem. I believe web is long overdue for a torrent like model where hosting is shared among all users (and ISPs).