3,074 karma · joined September 25, 2016
> Why has not a single person been prosecuted since the files were released?
Because the perpetrators run the government.
Maybe, but it continues to be one of the best places to find work.
In theory or in real life?
One thing that I find helps is just avoiding the word "why" as well. Restructuring to say "how come" or "I'm wondering..." or "am I understanding right that..." helps avoid putting people on their guard.
It even works on AIs, interestingly enough.
I don't think this is true. There are times when I do think it's true, and when I start feeling that way I know it's time to step back because I can no longer engage constructively.
Text is a hard medium to have a back-and-forth in. The features that make it useful for explaining also make it easy to feel ignored and insulted.
I think a lot of people also go online and write things when they feel argumentative, so comment sections self-select for people who want to argue.
Whenever I feel intellectually superior to someone, I try to remind myself that I can barely change the oil filter in my car, and there's a lot of people out there who can't write a line of Python but who save tens of thousands of dollars doing their own maintenance.
Because it reasons in one direction. First it encounters some kind of issue with 2-3 lines of Python that might make it not work, and then it goes onto plan B, which is making a library, but it doesn't circle back and compare the effort of making the library to working around whatever might make the 2-3 lines not work. Except sometimes it does, because it's inscrutable.
> The core issue there isn't that the LLM isn't building internal models to represent its world, it's that its world is limited to tokens. Anything not represented in tokens, or token relationships, can't be modeled by the LLM, by definition.
I've noticed that LLMs struggle with tic tac toe, even when I get them to draw it out. And it makes sense! Tic tac toe is an extremely visual game, and difficult to reason about in a single dimension.
LLMs are not capable of this kind of reflection.
It's pretty clear to me that above a certain size threshold, LLMs are more than a sum of their parts. The sheer amount of training data seems to embed a higher level of reasoning.
"is" is doing a lot of work in that sentence. The data centre doesn't exist.
> A policeman sees a drunk man searching for something under a streetlight and asks what the drunk has lost. He says he lost his keys and they both look under the streetlight together. After a few minutes the policeman asks if he is sure he lost them here, and the drunk replies, no, and that he lost them in the park. The policeman asks why he is searching here, and the drunk replies, "this is where the light is"
All of your suggestions are better but they're hard, so someone casually evaluating an AI isn't going to do them.