The open web is a platform for freeloaders. Since day 1 the expectation is that whatever is accessible will be free. And whatever isn't will be made free by whatever means necessary. Web content creators/publishers don't bother with micropayments infrastructure because no one is going to pay. Ads are a proven business model and they are going to stay.
There are other platforms where micropayments have in fact been solved – see Twitch, OnlyFans, YouTube, Substack, Patreon, IAP on iOS/Android, WeChat, Gaming. That's where the innovation in the space will be because that's where the money is.