1,099 karma · joined August 17, 2018
ndukt.com
Right now my app allows users to export build metadata as JSON which can be interpreted by LLMs for analysis, but I'd like to have this work on-device.
Location: Golden, CO
Remote: Onsite, remote, or hybrid are all okay.
Willing to relocate: Negotiable
Technologies: AI / PyTorch / Tensorflow / Typescript / Next.js / AWS / Node.js / Vercel / Swift / iOS / macOS
Résumé/CV: https://fractional-engineer.com
Email: kenny@ndukt.comidk, we’ve (humans) gotten this far with them. I don’t think they are the right tool for AI generated code and coding agents though, and that these circles are being forced to fit into those squares. imho it’s time for an AI-native git or something.
Maybe more suitable for a vibe debugging addendum.
Nobody uses NSURL anymore...
Location: Golden, CO
Remote: Yes
Willing to relocate: Negotiable
Technologies: AI / iOS / macOS / Swift / PyTorch / Tensorflow / Typescript / Next.js / AWS / Node.js / Vercel
Résumé/CV: https://fractional-engineer.com
Email: kenny@ndukt.comAlso I find it neat that they still include an iOSMath bundle (in chatGPT too), makes me wonder how good their models really are at math.
There is definitely benefit to using language models correctly in law, but they are different than most users in that their professional reputation is at stake wrt the output being created and the risk of adoption is always going to be greater for them.
> guarantees privacy by default, works offline, and doesn't rack up a massive API bill at scale.
I’ve been really interested in on-device ML for most of my career, and now I wonder how valuable these benefits really are. LLM vendor APIs are pretty performant these days, security is security, and with an on-device model you have to provide updates every time a new model comes out.