10,807 karma · joined August 12, 2016
(I'm aware that some places I've been to require foreigners to carry passports at all times but luckily it's never been an issue.)
Overall a cool tool, but pretty annoying. I point it out not really to criticize this project, but because I see a trend in software that has a holier-than-thou sort of paternalistic tone. LLMs are obviously rife with this, but I also see interfaces from some humans that give me the vibe of a snooty Parisian waiter.
It's Nix on the inside but the language is Guile Scheme instead of Nix.
Literally HitL-er
The flip side is that it takes four H200s to run, and that will only let you cache context for maybe three users.
Fingers crossed our Blackwells show up and Kimi 3 really releases weights, because at some point devs are spending a significant portion of their salary on tokens and it's somehow cheaper to buy these ridiculous DGX servers and rack and run them.
Astonishing nominative determinism there