But you distribute the js that accepts the passphrase - so you could trivially exfiltrate the password - and so access the private key.
"Don't have access" is a little too strongly worded IMNHO.
(I understand the reasoning - and I don't necessarily think it's bad - I just think it overpromises a bit)