> final method
A pedantic Pete would mention C++ has member functions.
325 karma · joined December 29, 2023
A pedantic Pete would mention C++ has member functions.
> As one engineer put it, “This isn’t engineering, it’s hoping.”
As one LLM put it, rather.
That's not nearly enough, though. The multi-node/GPU inference and specifically batching (and ordering in batching) have non-deterministic consequences for the current LLM services.
Fixed: I am so excited to take these millions of dollars.