That's certainly been discussed many times. It's an interesting concept. The main downside though is that if each site has its own renderer, with no shared concepts like the current web has, then you lose out on things like easily making accessibility tools, web scraping, etc. etc.
The benefits are also clear though, basically not being limited to current standards.