I really don't understand why they didn't go with Julia, it fits the purpose much better than Swift, already having a ML ecosystem and having great interop with Python, C, C++, R and Matlab.
Heck JAX, where a lot of TF refugees are going, is pretty similar to Zygote