Users of fail2ban shouldn't lay back, it hits you too [1]:
logger -p auth.warning -t 'sshd[123]' 'Illegal user user1 from 1.2.3.4'