pieter3d··on Breaking the 1.58-bit Barrier for Ternary LLMsIt also means you can read them faster, more parameters per second during an inference which tends to be memory bandwidth limited on most systems. Thus faster inferences
pieter3d··on When would you ever want bubblesort? (2023)I think because they are not necessarily consecutive.
pieter3d··on Qualcomm acquires RISC-V focused Ventana Micro SystemsA perfect target for Intel then, followed by a rapid exodus of the employees and destruction of the IP (like every other Intel acquisition).