By "toy TPU", we simulated forward pass + backprop on a minimal tpu-like accelerator.