nokeep.ai - private, uncensored AI -- launched it cause most folks who want privacy or less censorship attempt to run models locally but that obviously doesn't work unless you invest in hardware / want speed etc.
20 karma · joined November 21, 2023
thimble is a model i spent the last week of my evenings trying to train in order to beat needle 2 -- a 45M param tool-calling model trained on 153+ billion tokens by a funded team (u/cactuscompute)
my model: 48M params, ~1 billion tokens, $260 total (so 150x less training data)
the model wins 3 of their 5 published benchmarks, including seal-tools, the headline suite of their eval and the hardest one to move (so not a complete victory but still incredibly impressive results if i have to say so myself)
weights, code and results from every failed experiment is public -- and tbh all the fuck ups were the best part of the whole process, learnt a lot about synth data, model arch and training along the way
code: https://github.com/nikshepsvn/thimble weights: https://huggingface.co/flashvenom/thimble
i built this using openrouter data thought this might be useful for myself and other folk
collection of projects and writings
i love looking up new models to swap to and improve speed, reduce costs etc but its always a pain
this makes it so much easier
any attention is better than no attention, so here is my proposal to the void (:
would love thoughts and feedback, researched and written with the help of gemini and o3.
would love thoughts and feedback, researched and written with the help of gemini and o3.
one of my first posts on the platform! i quit my job last august and have been spending my time building experiments in AI and crypto -- during this time i spent a lot of time wondering about the future post actually good AI (context, hallucination etc solved) and this is my take on what companies might look like (and what I'm building SCULPT to become)
would love some thoughts, its ambitious but i do think we're headed there sooner rather than later