6,610 karma · joined January 17, 2014
Some fun stuff:
https://borgcloud.org/speech-to-text at $0.06/h
Roxy: iOS hands-free voice AI: https://itunes.apple.com/app/id6737482921?mt=8
Turing Test Battle Royale: https://trashtalk.borg.games
meet.hn/city/43.6534817,-79.3839347/Toronto
Socials: - linkedin.com/in/victor-msu - reddit.com/user/lostmsu - github.com/lostmsu
Interests: AI/ML, Gaming, Networking, Programming, Research, Science, Startups, Technology
---
DS v4 Flash update maybe, but it is too big for typical Joe's desktop.
Meta actually relesed official 4 bit quants in 17GB, but I haven't seen any indication that training was quant-aware, so the quants are not going to have same performance. 3.6 27B has official FP8 quant that AFAIR was trained with quantization awareness.
The best example is last year's gpt-oss which was released prequantized in mxfp4 so 20B parameter model was under 14GB and 120B was under 70GB right away.
UPD, NVM, got misled by comments here. It is actually almost 60 GB so much larger
Everything that came after is BS, everything that came before is obsolete.
UPD. was wrong on smaller, it's actually much larger
The lady even told you the reason, but you still brought up the climate change, religion, and social media.
Salmon is not too important anyway.
Second, I used my own custom window manager on Windows: https://github.com/StackWM/
I believe your problem is that "effort" is unspecified. "some effort" would make the statement correct, but some effort does not justify arbitrary effort, therefore you have no point here.
The way LLMs are trained the answer is of course yes, but they don't remember them all exactly, of course.
This is such a low bar literally anything would clear it. Even tomato farming.
No they don't, not efficiently (if you are referring to indirect access).
"Normal" is synonym to average in this case.
The only real non-slop is manufactured/built/grown stuff and a relatively short list of art works.