The author also works for google brain though, so i doubt that they failed to consider GPU/TPU. Really "worker" is just too underspecified to say what it really means.