Correct, private keys can only be decrypted client-side, the server doesn't have access to the password that they're encrypted with. Otherwise it wouldn't be end-to-end encryption, IMO :)
"Don't have access" is a little too strongly worded IMNHO.
(I understand the reasoning - and I don't necessarily think it's bad - I just think it overpromises a bit)