Yes, that's true it's not end-to-end encrypted as you say.

Here's more information about that https://github.com/jitsi/jitsi-meet/issues/409