Ive been thinking about this a a lot, like now if LLMs can just try a bunch of things, you can just try them all now. Are there some applications where we can just brute force and test at scale and no longer need to understand? Where understanding is now in essence that it “works” and passes our acceptance tests.
I don’t think appeals to morality or ethics are required for this. You paid for the LLM’s output, you should be allowed to use it how you wish. The only reason distillation is a dirty word is the AI labs trying to spread FUD to protect their non-existent moat.
It’s to the point I don’t even read Anthropic’s marketing blog anymore lol. The ai psychosis is just so real when people take these fluff blog posts which never have evidence or reproducibility and treat them like gospel
It’s crazy to me that companies/researchers share important data with these AI labs, you’re basically giving them your secret sauce which they then share with all of your competitors via training on conversations. At the same time I don’t really know alternatives other than a slightly less than frontier local LLM. Not sure how good they are at math.
I don’t think you realize how often depressed people say they will but don’t commit suicide, and also being able to know when is quite remarkable - I think this study is pretty interesting, and not as obvious as you think it is.
The models are open source, it’s never been a requirement for someone to document the entire process of creating something to be “open source”. Just sharing the source, in this case, the weights, meets the criteria. Software engineering’s obsession with precise terms is actually one of the things I’m glad is dying with ai automation.
Yeah I fully expect companies with lots of GPUs but not a good model like Microsoft and Amazon to just take these open weight models and make money, the GPU expense is the only moat at this point.
It’s classic commoditize your complement, nobody can replicate the cloud providers, everyone can replicate the models with open weights.
Yeah but we still don’t have execution vans! I’m not even being sarcastic. China is unequivocally worse even with our recent slide into towards totalitarianism.
In the 2010s all of my exams were still hand written and I went to Brown.. has everything really been computerized that much?
I think the tricky part here is essays, but maybe they should be replaced with an oral exam + essays? A lot of the humanities and classics courses I took were pretty small.
Overall I don’t think these problems are that hard, I just don’t know if the incentives of universities align with fixing them. If their reputation is all that it’s for, grades don’t really matter as long as the $$$ is coming in.
Wtf? What a joke, but I mean the best way to become a billionaire is convince someone with a billion dollars to give it to you. This is actually insane, wow. I guess Qualcomm is desperate? Nobody was bidding for this, but congrats to the team at modular?! I’m actually salty about this because like I don’t feel like mojo was even good after trying it out.
I work on PyTorch torch.compile and it’s a tracing compiler as well. Perhaps this domain is very narrow though; it is also a very not conventional compiler, you’d probably be deeply offended by some of the stuff we do! ;)
The idea of them purposefully wasting my time by having the model act dumber and me having to argue with it without knowing if it’s the prompt or the model was just such an idiotic product decision I can’t believe they shipped that without getting any feedback from users first.
Ah, the ever present “nothing to see here” take. What this government is doing is worse than it’s ever been. At least before when you had your grant it wouldn’t be randomly cancelled at any time.
By the letter of the law the guy fixing his car should be prosecuted, but like nobody is going to know and it’s not going to happen. In this case it’s pretty obvious the law was broken.
Look! A guy built 95% of slack in 2 weeks! Very skeptical of that btw, but also an organization that justifies every single team by exactly how much $ value they’re generating sounds like hell. How would you ever innovate or try out new ideas? It’s important to quantify what impact your team is generating but there are some cases (e.g. UX) which are really hard to quantify in $ but are still very important for the product
I read the tests, it also is really really good to have Claude verify that removing the changes in question break the tests. This brings the quality way way up for me.
Bro nothing is verifiable, you have to make a call in the end or you can just sit here and be like “oh but what about the speck of sand on the body, GOTCHA”. I used to be like you trying to poke holes in every little thing, but 1 it’s annoying to everyone and 2 you have to eventually take a stance other than “every stance is wrong” your mystical perfectly evidenced war crime is never going to exist, congrats! What do you think actually happened here? The article cites plenty of evidence, eyewitness testimony, make the call. The IDF themselves said they killed them. It’s a family, what do you think justifies that?
Seen this on repeat lately - there will be some war crime that the IDF commits, soldiers or Israeli citizens celebrate it themselves in a TikTok or in Israeli media, then the US media will argue that it didn’t happen or “there’s some information missing”. It’s actually kind of nuts.