Ok so I won't be writing engine code necessarily in Swift. Or servers. But I'm not sure that's what it's for in the first place.

How about user facing apps? Haven't we been through this a billion times on language of choice for job. Java, python, php etc. Each has a use. For a lot of what Swift will probably and should be used for I don't see this being an issue that hasn't already been beaten to death.