The same is true for anything. It's possible we could stumble into a dragon and unless we've built dragon defences it'll be too late.
And if we're hunting for dragons should we wait until we find one and bring it to the castle before we start discussing how to protect people from it?
Why does protection from AGI require something extraordinary? Secure your system and it doesn’t matter if you’re being attacked by AI or script kiddies.
The threat people perceive with AI isn't that they will hack systems.
I mean if we're spending 100 billion a year on finding dragons I'd be pretty concerned and would think about dragon defenses.