Please check out Matrix.

You will get what you described without even needing a phone number and WITH E2EE