Matrix isn't centralized, though it's true servers do the heavy lifting for now (eventually you will be able to run the server on the clients)