Fluffy.chat supports E2EE and is cross-platform: https://gitlab.com/famedly/fluffychat

(Though it might not fit your needs completely, as it's written in Flutter, and Flutter is pretty bloated too...)