It still does not solve key distribution.

Matrix P2P removes the homeservers, but clients are still talking to each other through some medium that can impersonate them.

There's really no magic solution to solve this, you need either a trusted third-party (such as Certificate Authorities, who are expensive) or a Web of Trust (impractical for users).