To some extent what you're suggesting is what https://revolt.chat is already attempting.
[1]: https://github.com/revoltchat/self-hosted
> This is still a work-in-progress and some things may not work but for the most part everything has been tested without issue!