Why? Will Nvidia just fall over if ternary networks become realistic? Or will they build a ternary Rubin? I know which one I think is more likely.

These are MLPerf training results. I think current ternary quantization research is focused more on speeding up inference?

Not necessarily, if the training is more efficient, you just throw more data at it for better models which was not possible before