Kerberos + ssh is amazing. I don't know why more people aren't aware of this holy grail setup.
Vault also has SSH backends that you could find useful
Also make sure to deploy the ssh keys somewhere the users can't write for extra security. Don't allow them to control their own authorized_keys files! :-)