if we are talking about regulating something now, we must talk about capabilities now. there's no point in talking about nonexistent technology. should we also regulate teleportation? it's been done in a lab.
if AI actually is a threat, then it can be regulated. it's not a threat now, period. preemptively regulating something is silly and a waste of energy and political capital.