I can't admit to myself there's any open question as to if there is any long-term value.
I expect within 2 years, this will seem like a non-controversial idea, and it won't bring in a ton of assumptions about the speaker.
I have invested much time and effort making sure local models are a peer to remote ones in my app, and none, including DeepSeek's local models, are remotely close to the things needed to make that flow work.
EDIT: Reply-throttled, so answering replies here:
- The machine is building the machine: Telosnex, a cross-platform Flutter app
- it can do 90% of the scope, especially after I wrote precanned instructions for doing e.g. property-based testing.
- Things it's done mostly wholesale: -- secure iframe environment, on all 6 platforms, to: execute JS in, or render react components it wrote. -- completely refactoring my llama.cpp inference to use non-deprecated APIs.
- Codebase is about 40K real lines of code. (I have to think this helps a lot I doubt that ex. from scratch it would be able to build a Flutter app that used llama.cpp.)
- $30/day!?! -- Yeah, it's crazy, its up an order of magnitude from my most busy days when I just copy-pasted back and forth. It reads as much code as it wants, and you're doing more work literally, so it adds up.
- $20/day is realistic average
- Lines added per day +55%, lines deleted per day +29%, files changed per day 9 -> 21 https://x.com/jpohhhh/status/1881453489852948561