The reason for this limitation is actually on the IRC side - we can only have so many users connected via Matrix, so we need to time out stale ones.
30 karma · joined September 12, 2019
I assume they're now aware of it :)
Privacy-wise there's certainly more fingerprintable data available to the program than what you would get in a typical VM.