Hacker News Reader

It’s by far the most popular data type for training neural networks.

for lack of bfloat16 support

whats the difference between float16 and bfloat16?

number of exponent bits. bfloat16 has a larger dynamic range with lower precision. e.g. this would be infinity in fp16 https://float.exposed/b0x5f80