Interestingly, this paper is the tombstone for TF1 and TF in general (read the text). My main comment is that as a person who supported TPUs, systems like this were always making it hard for regular researchers and product teams to make forward progress, because too much eng resources were assigned to whatever crazy idea Jeff had that month.