The original URL for this prediction will no longer be available in 11 years (2011)
longbets.org
longbets.org
One of my first web projects involved a music forum and I have been keeping the URLs alive for 24 years now:
https://www.gnoosic.com/discussion/
I feel like I owe it to the people who participated to keep it online forever. Also as a document of history.
Given how many things want me to pay a subscription while I'm alive, surely somebody will start charging me when I'm dead. It is the logical conclusion of SaaS. I wanted to create an acronym for this, but death as a service didn't seem like the best choice.
100-Year Plan: $38,000 (hosting and domain)
100-Year Domain: $2,000 (one-time purchase, no annual renewals)
Oh! So its your website. Cool.
Did the money change hands, for this bet, in 2022? How do you ensure it. Or is it honor based?
"Just".
Maintaining and keeping these tests (and the oriinal link) running is also probably easy. "Just" keep maintaining them over changes in technology, hosting providers, DNS registrars...
The original long bet was whether or not computers could pass the turing test by 2029: https://longbets.org/1/
You'd think that LLMs fulfill this, but I do wonder if a clever human could still discern between them given their particularities.
https://longbets.org/9/ is another interesting one depending on whether you think covid leaked from a lab or not.
You don't even have to be that clever. We've all tried using it for work. They fail.
In the first place, the Turing test was always a loosely defined thought experiment. I suppose it's still serving that purpose, but at least half of HN takes it way too seriously. It's absolutely not proof of <engagementbait> endorsed by Alan Turing himself.
You would have to train it/finetune it on a couple hundred of 'humans chatting in the context of a Turing test'.
What's more interesting are the types of humans that might fail the Turing test. Maybe to discourage the failure of real humans, there could be consequences outside the context of the test.
That is, most people accused of being a computer would crack and start pleading their humanity, but some sociopaths might not. I then wonder how many of them overlap with those so invested in abusing the premise of the Turing test.
It really is a fun thought experiment when you spice it up enough.
The big problem with the Turing test always was that it doesn't take into account adversarial designs. They had those chatbot contests about a decade ago, where the chatbots would regularly pass the turing test, not because the bots were intelligent, but because they were packed with rhetorical tricks designed to avoid saying anything of substance.
By any meaningful measure, today's LLM's pass the Turing test. Except we may need to lobotomize them for the deception to work.
However such good conversational agents would still have benefits, and i would be curious how far the approach of building a model that’s nice to talk to can take you, as opposed to the current generation of all-knowledgable helpful assistants.
Terminator (1984 film) had a scene showing that in a future 2009, humans would use dogs to try to sniff out whether a robot passing for a human is secretly a machine.[1]
In our real world 2026, there are no humanoid machines that can complete basic generic tasks, like carrying a tray across the stage and holding it for 30 seconds.[2] They move slowly and badly (probably from an LLM like neural network doing very few frames per second of correction and analysis), and are nowhere near lifelike.
When they don't need a body to pass for a human, such as typing online, they do a bit better.
We can tell them apart from humans. As you say, they have stylistic quirks. And you mention that they're easy to spot because they come trained with inhuman amounts of trivial knowledge.
It is also clear that is is also not really aware, either. I think Turing would be tickled that we find ourselves in an intermediate state that he would not have imagined.
They just prompted it to talk the way a 13 year old girl texts.
(Also they prompted it to pretend not to know anything about anything.)
If you used a smaller corpus, followed a different kind of fine tuning routine with rather normal conversation patterns, and wrote a different base prompt, I don’t see why it shouldn’t be possible to come up with a very particular personality, so to speak.
IIRC, PARRY https://simulation-and-society.org/parry/ got there in 1972 by pretending to be a paranoid schizophrenic person
PARRY is my spirit animal.
> In empirical evaluations conducted during the 1970s, experienced psychiatrists proved unable to reliably distinguish PARRY's responses from those of actual patients diagnosed with paranoid disorders, achieving only 48 percent accuracy, a figure statistically indistinguishable from random guessing.
https://www.cs.cmu.edu/afs/cs/project/ai-repository/ai/areas...
Yes, especially if you use the original adversarial setup with three simultaneous participants (judge, two candidates) as described in Turing's original paper.
However, I'm not quite sure how long even that one will last.
It was removed early 2011. Is this what happens when they can't decide on who won?
I think the clear winning strategy is to find some of the common sense reasoning fails that are still quite common, like the "should I walk or drive to the car wash" one from a few months ago.
The reason for the mistake is irrelevant here. All that matters is that you catch the agent saying something that basically no human would, especially in this type of game.
That shouldn't be an issue. The very act of taking the car to car wash contains the information that it is with you and you are at your home. Doesn't this prove that LLMs don't actually think?
Another approach could be to probe the helpfulness of an AI. A human would likely not comply with a request to write a sonnet about tangerines.
And no, I don't think humans would make the same errors, the key reason for this failure mode is that there are some facts of human day to day life that are so mundane that they are virtually never written about, thus making them an ideal combination of universal human experiences but out of distribution for the LLMs.
While LLMs are very capable of appearing human in general conversation, the test is that they are trying to convince a human that they are human, which is not something that is in their training data and I suspect they would go about things in very odd ways from an actual person, especially when challenged by an actual person. It is still very easy to back LLMs into a corner where they fall into very unnatural patterns and in my experience challenging them on their "humanness" (or anything) backs them into that corner.
LLMs also still can't use context or subtext in natural ways and even people who are terrible with purposefully exploiting context and subtext, generally have a natural ability that they developed to use and parse them. In a short conversation that is not adversarial, this is not an issue but falls apart as the length of the conversation grows or they start getting challenged.
LLMs just don't play with ideas and conversation like we do, they don't riff on it and go with the flow without care, picking up on subtexts and contexts and manipulating them the way people constantly do without effort until they find themselves on the edge of a cliff looking into the void and debating if they should jump. If we are put into the situation of proving we are human (in an academic test sort of way) we will play with it and have fun with it, and we will find ourselves on that cliff looking into the void, debating if we should expose ourselves and admit things we normally wouldn't. We pick up on this when people do it, even over the internet, their way of stating things changes and their subtext falls away or drastically changes; I have never seen anything approaching this in LLMs.
So we don't actually know how good LLMs can be in this.
There is also the problem with how easy it is to back them into a corner where they start acting in very unnatural ways. This would arise when challenging them on their humanity and most people would pick up on it and craft their challenges around it until it fell apart because that is how people work in such adversarial situations.
Sounds like Neuro-sama to me.
Anyone know why this (and many other bets) have been removed?
https://web.archive.org/web/20080803213625/https://longbets....
>By 2010, more than 50 percent of books sold worldwide will be printed on demand at the point of sale in the form of library-quality paperbacks.
Not exactly a hot-button issue.
Arguably, ELIZA passed the Turing test ca. 1967: https://archive.computerhistory.org/resources/access/text/20... and not that long ago, ELIZA was still more convincing: https://arstechnica.com/information-technology/2023/12/real-...
The Turing Test can be gamed. This was done in some Loebner Prize entries: see https://www.behavior.org/resources/325.pdf and https://en.wikipedia.org/wiki/Eugene_Goostman
To determine whether a machine is intelligent, I think it's necessary to understand how it works internally and not just take a black-box approach. This was already understood when Alan Turing wrote his 1950 paper. Elmer and Elsie, William Grey Walter's tortoise robots built during the preceding two years, appeared to behave as if they had some degree of self-awareness. But their "brains" consisted of only two thermionic valves, so self-awareness can be ruled out.
I'd only consider an AI to pass the Turing Test if an expert in how the AI works who prepares in advance for the test is unable to tell it apart from a human. The tester should even be allowed to use automated tools as part of the testing process.
If something is indistinguishable from a human in its outward behavior, then I'd be forced to admit that it's as intelligent/conscious/sentient/whatever as a human, regardless of how it works internally. It's not like I make my friends take an MRI before I decide whether they're intelligent.
You can be reasonably sure about your friends, as they're sufficiently like you to leave little doubt. I disagree but can understand you thinking that LLMs are intelligent, but unless by conscious you mean something like being self-aware, I don't understand how you could conclude LLMs are conscious. For example, although LLMs can tell you what colours things are, how the visual system distinguishes colours in humans and other animals, and what wavelength mixtures different colours are, they don't know what it's like to see colours because they cannot see colours. All the input of LLMs is text, and you can't describe, in words, what it's like to see colours, or hear sounds, or feel pain, in a way that someone incapable of these sensations would understand. And to remove any remaining doubt, there was an expert in colour vision (Knut Nordby) who, as he could not see colours because his retinas lacked cones, could not imagine what it's like to see colours, despite all his knowledge.
Your tangent on color vision/hearing/pain is not relevant. None of those things are required for i/c/s/w, nor is it obvious that a machine is incapable of feeling those things.
Also you keep using the term "LLM" a bunch here but I wasn't talking about LLMs. The question of machine intelligence is much broader than whatever the current state of the art happens to be.
We can tell that other people are intelligent and conscious because they're like us in important ways and we are intelligent and conscious. I haven't ruled out intelligent machines in general. My point was about the inadequacy of the Turing Test.
The part of this that's most likely to fail at some point is the "http://".
> A 301 redirect from www.longbets.org/601 to a different URL containing that text would also fulfill those conditions.
I assume this would cover the HTTP->HTTPS redirect scenario.
In particular, the automatic upgrade feature in modern browsers is based on several heuristics rather than explicit configuration like HSTS, so there's always a bit of room for breakage there. For example, they don't even check if the server returns a 301 redirect, which can be problematic if the server wants to redirect to HTTPS on a different host/port or make some changes to the path.
They're not going to get any cleverer than they are now. In October we'll finally be done with heuristics or central databses of https-first websites used by the various browsers or the half a dozen of headers that you must dance around to get the upgrade to work securely and reliably. They will just default to https first.
https://blog.google/security/https-by-defau/
Yes this is about Chrome, but all others will follow.
And in any case, at some point after browsers start doing that, I will be unsurprised if some further conditions prevail that provide reason for web servers to stop listening on http at all.
Now I'm a human slave copying text from web browsers to chat windows to get around JS rendering bullshit.
But I do the same as GP, just on the receiving side. That is, reaching out for help to baby eldritch entity, because that's healthier for my mind than dealing directly with the unspeakable horrors that half the websites are today. The industry has lost its collective mind in pursue of profit and control, and that was long before the thousand-mask wearing shoggoths became our daily consorts.
Even if you interpreted the bet generously to allow for a browser to render the content using JavaScript, if I understand the bet correctly, the condition of working with a command-line tool like curl would fail.
I can see how other interpretations are possible, but I don't see anything especially generous about mine. I'm not "allowing" anything: To make a judgement you have to pick a web browser to try it with, and you'd probably pick the most popular one, in the most popular configuration, that seems the most fair. If that web browser happens to execute Javascript when you navigate to an URL, then that's just how it is.
(Though, that said, some approaches to rendering sites via JavaScript would still have that text in the initially downloaded HTML file as JavaScript data.)
As for the "or", I read it as "doing either X or Y must", not "either X must or Y must (not necessarily both)", but yeah, I can see either interpretation being valid.
For the heck of it I confirmed "http://www.longbets.org/601" does in fact result in a 301 redirect to "https://longbets.org/601/". I suspected they might have used a 302.
That’s more than most will do, sure, but it doesn’t seem like it saves you from a broken link if you forget to add a specific redirect or miss it during a mass format change. Am I missing something?
Which is not, in my opinion, how things should be hosted on the Web.
Freenet had a different approach, even back in the early days (two decades ago). I interviewed Ian Clarke about it https://www.youtube.com/watch?v=JWrRqUkJpMQ
I wrote about it for years: https://community.intercoin.app/t/who-pays-for-storage-nfts-...
And recently I built Safecloud to be different: https://safebots.github.io/Safecloud/
I bet there's complexity to the topic, but I am sure you could put it into a few words instead of just leaving a hook for others to click on.
1. Data retention isn't infinite. If the source disappears from the network, peers will prune it shortly. This is exponentially true in our multimedia-heavy world.
2. Despite 1, if you actually want to delete something you published, you can't. Absolutists will see this as a good thing. Normal people will see this as a problem.
3. Peer-to-peer doesn't work in a mobile-first world, and not enough people will host nodes as a hobby. If all website publishers/hosters have to host a node, then we're just back to the current model but with extra steps.
The point was that mobile device doesn't equate spotty connectivity anymore for most people.
The reason why this is fundamentally quite hard is to do with routing optimization. Routing tables have to reflect physical connectivity - which means packets destined for F2::67 mustn't be routed to LA if that is the IP of a phone that is now resident in SF. However, changing routing tables on all devices along the way as a phone roams would not be an easy feat.
C:\Users\User>curl -i http://longbets.org/601/
HTTP/1.1 301 Moved Permanently
Date: Sun, 09 Aug 2026 16:49:33 GMT
Content-Type: text/html
Content-Length: 178
Connection: keep-alive
Server: nginx/1.18.0 (Ubuntu)
Location: https://longbets.org/601/
X-Frame-Options: SAMEORIGIN
<html>
<head><title>301 Moved Permanently</title></head>
<body>
<center><h1>301 Moved Permanently</h1></center>
<hr><center>nginx/1.18.0 (Ubuntu)</center>
</body>
</html>
Yes, I'm an old fart, yelling at the internet clouds. You'll get here some day too, if you're lucky.I am quite impressed that the bet included above redirection as part of the terms.