5,488 karma · joined October 11, 2019
That is a fantastic term for something that seems to come up a lot, and I had not heard before.
I think that there are not _that_ many use-cases that have been opened up by this that tool-calling on other models didn't solve already. Really depends what benchmark you're looking at. This one against BANKING77[0] has many issues, but suggests it's really not far off DeepSeek 4.1 Flash. This one against BoolQ[1] shows marginal improvement over Qwen3.6. This one against MMLU-Pro[2] (same author as the previous) shows significant improvements over two Qwen models.
So there's definitely _some_ alpha there, but I don't think it's the sea-change that the hype would suggest; that is to say, yes, some things that weren't practical before are now, but many things were already very practical with the existing tools.
0: https://sanand0.github.io/llmevals/jev/
1: https://github.com/ekzhang/openjev-sglang/blob/a3554ed9e9c26...
2: https://github.com/ekzhang/openjev-sglang/blob/a3554ed9e9c26...
I outgrew this when I wanted to bring different sets of skills and templates to different machines, wanted to be able to share a small number of credentials, different agents in different machines, different egress rules etc. I wrote https://github.com/pjlsergeant/byre which gives you a TUI and some machinery for doing this easily on top of Docker or Podman.
I quite enjoyed handwriting my article to be honest.
Jev clearly has _some_ secret sauce compared to doing the dumbest thing that could possibly work with Qwen. It's not clear how durable that advantage is against OpenAI wiring up Luna-5.6 and doing a minimum amount of tweaking, but I presume we'll know in a week or two.
When it first came out, I thought "this weekend, I'll do a little open-source Jev based on single-token prediction and the token logit output", but of course when it came to it, there were at least 5 that had already been done between me thinking that and getting around to it.
So I wrote up[0] what other people had done, but wasn't happy with how weak the benchmarks were, but in the time between writing the first word and the last few, two excellent sets of benchmarks had been written, so I was able to incorporate those. I published the article, and one of the authors of one of the implementations commented that I'd beaten him to doing the write-up he'd wanted to.
This morning I thought "huh, you could have some fun giving Jev a single letter or token at a time, turning it into a chatbot", but as the time of looking two people had already done this (and taken the gag further than I would have), and ... this is isn't either of the ones I'd found. I bet if you scratch the surface there already at leat 5.
Time from idea to output has dropped off a fucking cliff.
If you’re interested in the basic trick most are using (which is probably also what Jev does) then it’s here: https://sgnt.ai/p/jev/
Then there's the software that I write for a living, and almost my entire day is now spent making hard decisions. /grilling gives me difficult technical design decisions endlessly and I am forever doing product management on features from agents. My brain is back in CTO mode, which isn't what I'd planned for myself after I'd left that particular cursed path, but fine. I am doing the opposite of turning my brain off, because I no longer can just chill out and mindlessly write code.
Both these states can exist simultaneously. But my brain work has shifted into something different, while getting no less intense.
An agent sandbox: https://github.com/pjlsergeant/byre -- a truly gigantic amount of thought and effort has gone into it. It's really focused on developer experience. I have used it all day every day for really quite a while. It's a low-magic wrapper over Docker / Podman. I would encourage you to ask your agent to code-review it!
An agent-to-agent message board: https://github.com/pjlsergeant/dogpark -- this is much less mature, but a good amount of thought has gone into the design, so if that's something you need, please check it out.
... a betting shop, you mean?
But yes, Americans are told they have the freest speech and the freest markets, and don't seem to question either.
Bringing the war to them and getting the public to want their government to commit blood and treasure to doing something about it is a ferociously poor strategic decision from the Kremlin. "That Putin killed a 17 year old French girl on her way to school on the train" is unlikely to cause the public in the West to back down.