8,933 karma · joined July 2, 2007
This conversation just doesn't seem promising. Your initial wildly-off claim got me worried I might misunderstand the world by that much (I remember the 70s, fuzzily). I wasted time checking it, wondering if the actual peak might be in a year not mentioned, trying to find the paper Wikipedia cited: it was a non-open-access paper with at least four links to check; one of them did show the first page, which at least gave the figure in question, if not the ultimate source.
ID is not security.
I think I asked what deposit they would need. It had never been an issue before.
Similarly though admittedly more permissive, with Amtrak iirc it's like: you need a credit card and they probably won't check your ID. There were several more years after 9/11 before the "papers please" principle came for the trains and buses too.
E.g. search turned up a claim Greyhound "employees are not allowed to sell a ticket without an official ID" https://travel.stackexchange.com/questions/140703/i-have-no-...
I only know one person who's done that. In some ways there's been less future shock than we expected.
> brushed by the mountain summits of Malapert and Mouton
A counterargument written pre-LLMs: https://arxiv.org/abs/1104.5466
(The OP ends up at 210 meters.)
The thing is, you can interact with this new kind of actor as much as you need to to judge this -- make up new problems, ask your own questions. "LLMs can't think" has needed ever-escalating standards for "real" thinking over the last few years.
Gary Marcus made a real-money bet about this.
But ChatGPT a couple years ago was at more like grade-school level at problem-solving. What should I call this thing that the best LLMs can do better than the older ones, if it's not actual reasoning? Sparkling syllogistics?
Sorry, that's sarcastic, but... it's from a real exasperation at what seems like a rearguard fight against an inconvenient conclusion. I don't like it either! I think the rate of progress at building machines we don't understand is dangerous. (Understanding the training is not understanding the machinery that comes out.)
Compare the first previews of Copilot with current frontier "reasoning" models, and ask how this will develop in the next five years. Maybe it'll fizzle. If you're very confident it will: I'd like to be convinced too.
Then I come to
> [LLMs] can get better at reproducing patterns found online, but they don’t become capable of actual reasoning; it seems that the problem is fundamental to their architecture.
and wonder how an intelligent person can still think this, can be so absolute about it. What is "actual" reasoning here? If an AI proves a theorem is it only a simulated proof?
Neat term, debaiting -- though I misread it for a moment.
Tensor ops in e.g. pytorch are pretty opaque to me, too much implicit on shapes which can change as you go down a pipeline. Maybe I'll come to appreciate it better.
Perhaps you would also describe the Manson family as a Christian death cult.
(I have nothing to do with the site.)