Just shell/FTP passwords. As noted above, panel passwords are fine.