We created atom bombs with only a surface-level knowledge of quantum mechanics. We cannot describe what fully makes the universe function at the bottom level but we have the ability to rip apart the fabric of reality to devastating effect.

I see our efforts with AI as no different. Just because we don't understand consciousness does not mean we won't accidentally end up creating it. And we need to be prepared for that possibility.