Hacker News Reader

gemeralon Ask HN: Is traditional startup hiring advice outdated?

12 month cliff is standard in the industry though even at larger, established companies

That's not the right analogy. The "tok" in "Tiktoken" comes from "token", not "TikTok".

gemeralon The Era of 1-bit LLMs: ternary parameters for cost-effective computing

Do you mind pointing out where they make the model larger? The paper seems to suggest they are maintaining the same model sizes.

> Recent research, such as BitNet, is paving the way for a new era of 1-bit Large Language Models (LLMs). In this work, we introduce a 1-bit LLM variant, namely BitNet b1.58, in which every single parameter (or weight) of the LLM is ternary {-1, 0, 1}. It matches the full-precision (i.e., FP16 or BF16) Transformer LLM with the same model size and training tokens in terms of both perplexity and end-task performance, while being significantly more cost-effective in terms of latency, memory, throughput, and energy consumption

gemeralon The Era of 1-bit LLMs: ternary parameters for cost-effective computing

> and blowing up parameter count to make up for it

based on (an admittedly rapid and indulgent reading of the paper), it seems like they're not increasing the parameter size. Do you mind pointing out where the blowup is occurring?