4,015 karma · joined September 30, 2014
It really changes the calculus on some things with large volumes of data on my desktop. Admittedly, my desktop maxes out at 2.5 Gbps, but everything else in the house keeps happily chugging along.
I've been using Claude and other agents in Slack for some code tasks. It's mostly fine for simpler projects and products. Things like docs or specific libraries. But I'm not really convinced this is the ideal interface yet. Reviews are my bottleneck and GitHub has a great UI for this. Plus, token consumption with Slack is out of control.
Maybe in time this will be the way we work, but for now I still find myself using GitHub, a terminal, and slack together.
Domino is hiring for a number of roles!
Great pay, hours, culture, product, and mission. I went from being a long time customer to being an employee, because of my conviction.
I'm a little surprised by how much OAI is playing catch up here.
Reminds me a bit of hypothesis auto in its simplest applications: https://github.com/timothycrosley/hypothesis-auto/
It's also still just prone to the kind of "stupid" mistakes we see from all LLM's. Like it can write great code, but it doesn't really have common sense without enormous guidance.
The usual counter-argument is the operational burden, but human capital is also a relatively fixed cost. A dedicated team of 3-5 FTEs could probably handle inference ops for a F500 company.
Meanwhile, the capability delta is shrinking fast. We have more evidence that local open-source is viable with the release of DeepSeek v4, and the industry is only trending further in this direction. Especially as we rely more on test-time compute and task-specific harnesses rather than model size.
So, if you're an executive looking at a marginal but fixed operations cost, added flexibility, and a rapidly closing gap in capability, why wouldn't you just run open-source models on your own infrastructure to get those highly predictable costs? Plus, you decrease the risk of one of the frontier
Might really increase the utility of those GCP credits.