The November 2001 top500 supercomputer had 7.2 TFL0PS: https://www.top500.org/lists/top500/2001/11/

It's fun to compare it with the historical top500 list: https://www.top500.org/statistics/perfdevel/

The VRAM bandwidth is still under a terabyte per second so you still need a fair bit of data intensity to actually approach that. It's still amazing.

I think I know what Jesus In A Leather Jacket has planned for next year though.