SSH relies almost exclusively on the first connection to a server being correct and an attacker being unable to perpetuate a MITM attack against a given host.
Do you rely almost exclusively on the first connection to a server being correct? Apparently. Does SSH? No.