Hacker News Reader

That would be 1.38 bits per weight on average, which I can confidently guess would not perform well.

BitNet is functional at 1.58 bpw.

The model card says the 70B is 16 bit so I think you have twice that