Can you share some more details about the current state? Is it still written in Go?
Great use case for Go though, especially its concurrency features for web crawlers. I reckon Scala could work too, although it's a lot more complicated / clever.
Apple's server stack has been primarily Java for about 20 years.