Is ssh only allowed by public key? (in /etc/ssh/sshd_config => PasswordAuthentication no)
Is Apache or NGINX running on the server?
Is PHP/Ruby/Node/Python running apps?
What ports are open in iptables (iptables -L)
What does /var/log/auth.log say?