Matrix got ripped apart a couple of years ago and there are some questionable aspects https://securitycryptographywhatever.com/2022/11/02/Matrix-w...
https://matrix.org/blog/2022/09/28/upgrade-now-to-address-en... has our take on it, fwiw.
Fwiw, I believe Matrix (or possibly an XMPP+OMEMO setup) is the only current solution which fits the requirements of the OP.