Not saying it doesn’t exist, just saying this sounds dangerously close to a boomer talking about the 1950s
656 karma · joined February 21, 2022
Not saying it doesn’t exist, just saying this sounds dangerously close to a boomer talking about the 1950s
If you prompt an LLM to build a web game (or something) it iterates over and over until the game works. And these days the output does indeed work. If you look at the code, it can often be a jumbled mess, but it still does work. It will take some sleuthing to understand what it is doing, and, if you care, clean up the code.
I think OpenAI did the same thing with Lean. The implications are far more interesting, but from what I understand the proofs are “slop”. Correct, but not elegant in any way.
It is still a wildly amazing technique to find a solution (or possible one) to maths problems.
I have used LLMs to do things I didn't know how to do, then reviewed what it did and learned a new technique.
No reason it cant work like that for maths.
Not everything is a product.
It’s like competitive knitting, or competitive architecture.
This focus on the inane is what has really damaged this industries perception in engineering IMO.
And the solution in the article is: how do best make them conform, and “do a bunch of work on themselves” so they are not like themselves, but more like the average.
Really think about what you are saying here. How does one “cheat” solving a problem in the real world?
There is no such thing as “cheating” in reality. You are not in school. There is only solving the problem and not solving the problem.
There is breaking the law, of course, which still isn’t cheating.
The good news is it’s fun to see people discover and get excited about things that I like as well.
If you want something like that give them something novel to your industry for both of you to study.
I do not misunderstand, I think maybe you do. You think there is a proper next word selection based on logic or meaning and there for the model selected the wrong one - it hallucinated.
I am saying the model has no concept if anything other than the probability of select a token which is not based in any logic so it is working properly- it only works on numbers.
It is random chance that it is ever correct, not that it is correct often and messed up this one time.
Getting rejected for a job maintaining a CRUD application because you didn't use a trie to solve a pointless brain teaser that makes some junior 25 year old feel super smart isn’t.
Retuning inf or crashing would be an error.
If you want to ascribe some kind of meaning to the tokens, then maybe the training data was insufficient to predict the token in the sequence you wanted, but it doesn’t predict the next “fact”, and it doesn’t “think” it predicts the next token.
It’s clear what a big bomb could do, but these “whistleblowers” are not showing anything.
They’re like “imagine…”, no show me internal documents or training data or something other than trust me bro.
I can imagine quite a bit. That doesn't mean anything.
The one thing Ill give it is at least you can still run a binary with having to pay $200 for the privilege to compile an application.
What have we become?
I got fired for some reason.
What's your N(doom)?!
Everyone panic and give me money!
The most intelligent people I know are the least likely to want to harm anyone or anything, and understand that diversity is fundamental and important to the universe. Without proof to the contrary, why would you think some super intelligence would want to hurt anyone? Because you would?
If you are saying that some small bit of training data made the thing completely evil, then that really couldn’t be super intelligence.
These doomer people keep running around saying these kinds of things, but they all just seem like people who play too much D&D and want to larp as the main character.
Happy to be shown something that isn't based on wild speculation and some randos “this is whats going to happen in 2030 because of my vibes” kind of information.