Yes, the actual software runs at a single location. But apparently it's open enough that you could in principle run it in a distributed manner. As you can even cross-check the data and compute the same results deterministically, you could theoretically even do it as a blockchain, although it's unclear why you would. But you could, if there was value in P2Ping such a thing.
In that sense, Vitalik's point does land.