1,174 karma · joined December 8, 2020
From my mortal spot, I'm sad I'll never get to have another.
Rice made a good one in 'ya, though I suspect anywhere could have forged you well. You were made of the right stuff.
God speed Steve.
Usually models in this class nail things like that 1 shot, which the other side did.
I don't know the cause. It may be nothing. But I'd like to see the model doing something where its path is a bit more constrained, to help out rule out such oddities.
Knowing things like: Will my code end up in Grok? What ownership do I have of my content, etc... matter.
I wouldn't pick up 400gb of hardware to run in that mode. I might try it for fun, but even then you are looking at handling a 95GB active parameter set.
This is NOT a model for most home labs. I'm sure some can and will use it. But most, should steer clear.
Honestly this model people at home can tinker with, if you have a big enough Mac. Maybe 4 Strix Halo/DGX Spark, and then at 1 bit quant? Nah.
Use the right sized model, for your hardware. You'll get better results.
If you want to say MIT is soft. Feel free.
That is so vague with some of what I do, that it isn't worth even looking further.
My only question is how do you handle channels in the architecture now. From what I saw in Claude Code, shifting to a totally http world has some timeout issues if a server drops out and comes back. Because of that I'm stuck writing stubs for my internal use MCP, this is fine for me, but if you are cleaning up semantics: Understanding how we expect clients to act around failure would really help, the story.
You can state the math, but not why it won't discuss various topics, etc. Once you see the models waffling on subject with objective truths. You wonder what else is wrong.
I do not exempt US models from this. They do it too, ask anything about politics, elections etc. And they can get... weird.
It doesn't take much to create a systemic error class in a model at these scales. And history has shown nation states are willing to do these things.
Just be wary.
Until we know what a model is trained on, and how it is trained in high detail, I hesitate to call them "Open Source" in any way. They are free. But, we don't know what their priorities are etc. Witness the censorship we see in all models in one form or another. I'm not absolving any side of this.
Just saying: Don't be blind.
It really depends on the session, and what you are doing how far you can push it.
And I'm not advocating for no limits with no responsibility to the employer. That'd be stupid. Clearly there's a "more sane" middle ground.
Even on a menial job, they are dealing with more value than they make daily, by definition.
A middle road exists, and it is solid, why it isn't being taken, I don't know.
Nice try OP.
My first job had: Unlimited sick time. Take it when you need it. No doctor's note. I think you may have needed one at the week mark. Never hit at that employer. Most employers have been limited sick, with a note at a week.
I can't imagine note on day 1. That's just... nuts. The lack of trust shown there is massive. I'm making calls on stuff far larger than my sick days. If you can't trust me on sick days, how can you trust me to do my job?
Honestly: Think twice before dragging your firm into what you say.
Disclaimer: I speak for myself. Not any firm I am associated with.
That said, it hasn't been enough of an issue for me to want to fix.
AI will click as another tool in the toolbox.
I can tell you: Your problems are a layer higher than you think.
Coding, Architecture, etc. Those get the face time. Process, and Discipline, and where the money is made and lost in AI.
To give a minor example: My first attempt at a major project with AI failed HORRIBLY. But I stepped back and figured out why. What short-comings did my approach have, what short-comings did the AI have. Root Cause Analysis.
Next day I sat down with the AI and developed a PLAN of what to do. Yes, a day spent on a plan.
Then we executed the plan. (or it did and I kept it on track, and fixed problems in the plan as things happened.) On the third day I'd completed a VERY complex task. I mean STUPIDLY complex, something I knew WHAT I wanted to do, and roughly how, but not the exact details, and not at the level to implement it. I'm sure 1-2 weeks of research could have taught me. Or I could let the AI do it.
... And that formed my style of working with AI.
If you need a mentor pop in the Svalboard discord, and join #sval-dev. You should be able to figure out who I am.
I'm excited to work with AI. Why? Because it magnifies the thing I do well: Make technical decisions. Coding is ONE place I do that, but architecture, debugging etc. All use that same skill. Making good technical decisions.
And if you can make good choices, AI is a MEGA force multiplier. You just have to be willing to let go of the reins a hair.
As an older and higher up engineer, I worry more for the youngsters than myself. I'll find a spot. I'm using AI, I'm doing things at rates that are pretty crazy.
That's all powered by decades of good decision making practice. Youngsters don't have that. They don't have the painful lessons hard earned.
The background on your site genuinely made me wonder what was wrong with my monitor.
You want them writing tests especially in critical sections, I'll push to 100% coverage. (Not all code goes there, but thing that MUST work or everything crumbles. Yeah I do it.)
There was one time I was doing the classic: Pull a bug find 2 more thing. And I just told the LLM. "100% test coverage on the thing giving me problems." it found 4 bugs, fixed them, and that functionality has been rock solid since.
100% coverage is not a normal tool. But when you need it. Man does it help.
Freedom of Speech guarantees the right to speak. Not the right to have no repercussions.
Elon has GREAT interest in Freedom of Speech, it enables him to have far more power than regulating the type of "speech" he showed in cancelling that customer's order.
I want to make the conference committee choose between "Do we want ilc's talk on X." or "Do we want foo's talk on Y." If we are both discussing the same thing, if I'm unknown, I will lose. OTOH, if I have something interesting to talk about... I have 2 routes to "victory". "ilc gives great talks, he gets good grades and is working on his skills." and "Man that's a damn cool topic. We want that at our conference, even if ilc isn't the BEST speaker, the combo is better."
I didn't start out as the best presenter. I learned. But I always knew I had to have an interesting topic, something that made it worth them giving me a slot.