The Prospect of an AI Winter
erichgrunewald.com
erichgrunewald.com
Reasons:
1) We are currently mining just about all the internet data that's available. We are heading towards a limit and the AIs aren't getting much better.
2) There's a limit to the processing power that can be used to assemble the LLM's and the more that's used the more it will cost.
3) People will guard their data more and will be less willing to share it.
4) The basic theory that got us to the current AI crop was defined decades ago and no new workable theories have been put forth that will move us closer to an AGI.
It won't be a huge deal since we probably have decades of work to sort out what we have now. We need to figure out its impact on society. Things like how to best use it and how to limit its harm.
Like they say,"interesting times are ahead."
2) The available power seems to be growing pretty rapidly and dropping in prices. I think there are still quite some gains to be had from architectural optimizations (both in hardware and in models).
4) They were defined decades ago but I think they did actually seem to move us closer to AGI only recently.
You might be right, and there are definitely interesting times ahead! But I kind of doubt that we will have decades to sort out what we have and figure out its impact on society (which is a bit scary).
1/ We humans are still generating data. To live is to generate data and while it is dystopian to think about how these data can be harvested, it is still possible to get more information to feed the next gen AIs. And remember that right now, we have only used text and images. Videos, audio, sensory inputs (touch, smell, taste, etc), and even human's brainwaves are still available as more training data. We are nowhere close to running out of stuff to teach AIs yet.
2/ Fine tuning and optimizing training has shown tremendous effects in reducing the size of these LLMs. We already have LLMs running on laptops and mobile phones! With reasonable performance and in only half a year from the big release. There is lots of room to grow here.
3/ My nieces laughed when I told them TikTok is too invasive. Most people outside of HN does not care about data privacy as much as you might think.
4/Sometimes it only takes 1 big breakthrough to open the floodgate. Transistors was that point for computers and we are still developing new techs based on that 100 years old invention. We don't know how much potential there is in these decades old AI invention especially when many of them was only put into proper practice the last decade. We didn't learn the big mistake until very recently after all.
Just some ways things can go differently. It is the future, we can't really predict it. Maybe an AI can...
I guess it really depends on what you mean by "basic theory" but my view is that the framework that got us to our current crop of models (vision now too, not just LLMs) is much more recent, namely transformers circa 2017. If you're talking about artificial neural networks, in general, maybe. ANNs are really just another framework for a probabilistic model that is numerically optimized (albeit inspired by biological processes) so I don't know where to draw the line for what defines the basic theory...I hope you don't mean backprop either as the chain rule is pretty old too.
We are currently mining just about all the internet data that's available. We are heading towards a limit and the AIs aren't getting much better.
There's a limit to the processing power that can be used to assemble the LLM's and the more that's used the more it will cost
People will guard their data more and will be less willing to share it.
was defined decades ago
interesting times are ahead
We have "something that appears to work" but is this itself a local minimum? Biology found its own efficient processes that look a bit different after all.
In my opinion, "fundamental breakthroughs" would answer questions like:
- is there an inherent reason that humans learn through a process akin to statistical optimization, or is it a coincidence that feedforward-only gradient descent seems to work?
- Are there other models for "neurons" that go beyond GEMM, like spikey activations? We know from biology that they're nonlinear; how might they be modeled better?
- Are there ways of training effective agents beyond just the reinforcement Q-learning techniques that we've settled on?
- What does it even mean for a model to be able to "reason;" does our current view of recursive models with hidden state really map to that philosophy one-to-one or is there more?
Just note that this is not at all what most people mean when they say "AI Winter".
It is usually defined as less funding and general interest in investing in AI. Not "we don't know how to move forward towards AGI".
I recently came across this myself when writing a reply on another forum. A feeling of reluctance to attempt to contribute something maybe-useful in a public, 'minable' space.
Almost feels like this has tarnished the 'magic' of Internet, of sharing information and knowledge. I'm not saying this is the appropriate reaction, but it is what it is.
I used to be like this, but the reality is that ideas are a dime a dozen. Any idea that you or I (or anyone else) have had, have likely also been thought by thousands (or maybe add a few more 0's) of people.
What makes things happen is people not ideas. Talk to any VC or people involved in startups - it's all about the team, not the ideas they are working on.
I read this a lot, and it sounds intuitive on the surface. But I don't understand how it's justifiable. For example, all that exists in the Universe is a result of the application of very simple rules. It would make sense that information is not what is important towards intelligence and complexity, but computation. It ought to be possible to create a superintelligence with a few bytes of training data, given enough compute.
So an AI that simply recycles its own input ad infinitum might produce something but it won’t be meaningful to us humans. Hence, it’s unlikely to be useful apart from the novelty of it.
For generative AI, the hallucinations will poison the well. And they're not random, so same/similar hallucinations will pop up all over and reinforce each other.
I argue that this won't matter. I think Generative AIs will be much scarier than any sci-fi AGI. And this is because while sci-fi AGI apocaliptic scenarios involve the AGI seeking to exterminate humanity usually as a form of revenge (see The Matrix, The Orville and many others) or as part of an optimization, scenarios involving Generative AIs simply involve humanity destroying itself, and these scenarios are already very plausible.
Prepare for the complete destruction of objectivity, the onslaught of spam, grifts and fake news at an unprecedented scale and a flood of security vulnerabilities unlike any other. This will be the annihilation of interpersonal trust and of knowledge.
They have the human capability to ensure that it is state of the art in all current ways, and could theoretically use some processes that aren't disclosed to the public. I don't think anyone would say that China at least doesn't have the brainpower to do something like that.
Then, these government leaders could ask the AI to come up with simulations on how to conquer the world.
The AI would probably say something like, "America has to fall, since it's military might is the strongest resistance to your ability to dominate the globe".
How would you do that?
Ensure weak or compromised politicians get elected, which will make the American people lose confidence in their government.
Spend resources to ensure that the financial stability of the country is negatively affected. Do this by disrupting the flow of goods into the country, viciously competing with any product based company of any merit, and purchasing housing in the major financial centers of the country.
This serves three purposes:
1: Businesses will become tight-fisted with their spending wherever they can as they won't always know if they will be able to purchase the goods they need when they need them. The easiest way to reduce spend in the short term is to underpay and overwork your employees by firing the more expensive employees and shifting their workloads to others, so that will be the first thing that happens.
2: The smarter and capable people will attempt to escape the rat race by relying on their inventiveness. They will suffer in drudgery for years while they perfect a product that someone needs and is willing to pay for, and then, since manufacturing in America is ridiculously expensive thanks to China's price competition, they will outsource the manufacturing of their product to China. This will happen frequently, and they will be taking all of the risk for themselves.
Once they have a successfully tested product, China will clone the product and flood the market with inferior quality but massively cheaper clones, ensuring that the original business never achieves the success it could have and then has to cut costs, putting the employees of that company into the same conditions that the founder started the company to escape.
3: Housing will become very expensive, so the citizens will not be able to afford the same quality of housing that their parents did. This will further increase their unhappiness and destabilize the power of America.
Once all of that is done, then you let the kettle simmer for a while. Spend the money, time, and energy to keep the pressure up. Use the time to buy or subvert more politicians.
When this is done, the country will be weakened by its internal stresses and so charged that all it will need is a single strong event to vent all of that pressure on. A match to a powder keg will blow the whole thing up and America will collapse from civil war.
While that civil war is going on and the whole world is watching, launch your attacks. Take over your neighboring countries. Threaten nuclear annihilation on anyone that stands against you as within a few years you quadruple the size and power of your country.
By the time America pulls it's head out of the fog and realizes what is going on, it will be too late.
If AI starts to become economically important, there will be an incentive to create more data. If I'm OpenAI, why not pay a company to put microphones around their office, transcribing everything everyone says for training data. Buy troves of corporate (or personal) emails. If there are one hundred million office workers in the world, and you can convince/pay 10% of companies to let you spy on them, and each says or writes 5,000 words per day (these are all low estimates, in my opinion), you'd be getting ten billion more words of data per day. You'd double the size of the Chincilla training data in about a month.
If you incorporate video for a truly multimodal model, now you're talking about not only the entirety of Youtube, but potentially also CCTV footage. If you could get the data from every surveillance camera in the world, you'd generate one YouTube worth of video every ten minutes (based on 150 million hours of video on YouTube).
You appear to be assuming that the only way to make current LLM-based AI's better is by feeding them more and more data, but that's simply not true. These current (really first generation, not withstanding GPT's versioning) AI's are very data/parameter inefficient, and do not differentiate between data used to develop reasoning and data that is just pure knowledge. The short-term path forward is more judicious training set design to use less data, and require less model parameters, so that the model itself just learns to reason, and doesn't need to do double-duty as a database repository of facts as well. Retrieval-based plugins and similar approaches can be used to give access to external knowledge.
2) There will be many different sizes and capabilities of AI. They don't all need to be superhuman.
We are entering the AI age and just as the computer age didn't result in everyone needing a mainframe or datacenter in their garage (although there are uses for them), the AI age will not result in everyone running the world's most powerful super-human AI on their smartphone. There will be a range of AI's for different uses cases.
Current models are also very inefficient. We are essentially day 1 into the NN/LLM AI era. Think of ChatGPT as the ENIAC of the age. DeepMind's Chinchilla scaling laws have already proven how inefficient these systems are, with a suitably trained 70B model equaling the performance of a 175B one. There is tons more work to be done on efficiency and smarter model design.
3). Perhaps, but per point 1) we're not running out of data anyway, and there will anyways always be people/companies happy to sell data for a price, even if it is not for free.
Future AI's will learn the same way we do by experimentation and curiosity/surprise, and will not need to be spoon fed a training set in the same way as today's systems.
4) No idea what you're talking about here. NN optimization is hardly spent as a technique - that'd be like saying "we've reached the limit of what we can to with software development - we need a new idea".
LLMs as a path to AI, or building block of AI, are of course a very new idea - a few years old at best. A few decades ago no-one was even working on neural nets (current DeepLearning revolution basically started with AlexNet in 2012) .. it was all GOFAI symbolic systems - failed approaches like SOAR and CYC.
If you compare the Transformer architecture to the human cortex, and our brain's overall cognitive architecture, some of the missing pieces are extremely obvious. We're not at any sort of impasse as to how to move things forward.
Is this case really worth exploring? Or was the article written by a bored AI?
I find it striking that there are still so many people downplaying the latest developments of AI. We all feel that we are at the verge of a next revolution on par or even greater than the emergence of the www, while some people just can't to seem to let it sink in.
Just because people may have opinions different from yours doesn't mean they're denying reality. They just have a different opinion.
The hard, cold truth is that nobody knows the future. Everybody is just guessing.
Climate change is coming at us. That's still a prediction (it hasn't happened yet), but not believing in it right now is irrational and dangerous.
I don't think we can say that for AI. That AI will change the world is a belief. Doesn't mean that it won't.
Crypto's value fluctuation made more sense as a speculative asset class, and it clearly saw most of its traction there.
It's potential as a currency did lead to banks, financial institutions and governments taking a hard look at it. And CBDC's are an area of active investigation. So the hyper-optimists may have been off on some of their predictions, but something came out of it.
AGI-agencent tools are more grounded. They don't threaten to tear down existing entrenched institutions. They do one thing simple: commoditize and scale some level of intelligence. And they're pretty good at it, hence the hype.
Unless humanity develops a deep distaste for many things AI-made, the fascination will wear off and we'll be left with the cold hard truth of raw productivity increase and digital production on an unprecedented scale.
I disagree with this part. (I disagree with calling this tech "AGI-adjacent", too, but that's not the part I'm calling out here).
I'm not sure what you mean by "more grounded", but if you mean "more based in reality", I don't think this is clear. But, if what the evangelizers say is correct, it absolutely threatens to tear down entrenched institutions. It even threatens to tear down society itself by destroying what little trust remains.
IIRC, crypto was a little too idealistic in the promise of providing a digital currency without needing a central, trusted authority to back it. From my perspective, AI as we've seen it in the last few months simply provides a tool that can automate intelligent tasks easily.
I think the distinction is fuelled more by the companies and leading figures pushing the latter. OpenAI's stewardship, concerns for safety and generally downplaying how amazing these tools are while not ignoring the real effects they could have make AI sound more "grounded" than peak crypto was. Or it could just be the folks I pay more attention to.
> I disagree with calling this tech "AGI-adjacent", too, but that's not the part I'm calling out here
I think this rests mostly on the definition of "General" here. Here, I'm talking about LLMs as general task performers, as opposed to models created for more specific tasks. LLMs have proven to be more general purpose, which I'd argue makes them closer to the AGI ideal than, say, a sentiment analysis model.
Ah, I see. By that definition, it seems to me that cryptocurrency was actually more grounded than gpt.
Cryptocurrency (or even blockchain) has not (yet) changed the world. That was what everyone was predicting.
Then it hasn’t changed the world. That phrase doesn’t mean “a small number of things are different” it means that everything has pivoted.
That’s the definition of NOT changing the world.
but the examples of success so far seem cherrypicked leading to serious skepticism. there will be a revolution, and its already in progress dethroning entire business models but the future is still very uncertain.
what is humans role in this adventure into the singularity is even moreso clouded with more questions than answers
Bonus points for things that should cause us to make major adjustments (otherwise it doesn’t seem worth it to expend too much energy).
Have you ever looked at predictions from big consulting companies like McKinsey and the likes? "This new field with unlock a market of 30 billions in the next 5 years", that kind of crap?
In the fields where I worked, I used to take those predictions seriously (after all, they know better than I do, right?). What I realized is that they just don't have a damn clue. I can't blame them for failing: predicting the future is an unsolved problem. But making that kind of money by telling that kind of crap should honestly not be legal.
All that to say, some things are clearly coming right at us (ahem, climate change), some aren't (AI, for instance).
By all means keep your own estimates of what the world will look like in 10 years and act accordingly, but I'm trusting my own technologist's judgement on this one.
I’m excluding the desk jockey pundits from the argument, of course.
I am not estimating anything. I'm saying that there is no way to know where it will go. You are the one doing what the empty suits did: you are predicting something based on your beliefs only.
Not that you can't do it: everyone can believe what they want. But it would be wise to realize that it's a belief, even if you are a technologist.
I don't know, I don't see it this way. Bitcoin at the very beginning was an impressive piece of technology (still is), but it clearly did more harm than good.
Autonomous cars had some very impressive demos, and don't seem to have evolved much in a few years (it's impressive, but not good enough).
AI is making very impressive demos now, but it's not changing the world (what seems to work really well right now is to generate convincing disinformation at scale, which is not good).
To me it's all the same: impressive demo, but what matters is not the first 80%, it's the last 20. Everyone seems to be building infrastructure around what AI will become. Just like people built entire companies betting on the fact that cryptocurrencies would become global (they have not), or that blockchain would be useful outside from cryptocurrencies (it is not). Or like people built entire companies around "the new world with autonomous vehicles".
The problem is we got autonomous cars backwards. We needed multimodal GPT first. GPT-4 can look at a picture can tell you what's happening very clearly. Now, chain this together really fast and you have something that could be used for driving. I'm making no bets on when the hardware/models will be fast/cheap/power efficient enough to support this.
>but it's not changing the world
Eh, no, it is changed the world in a vast number of ways, but not spread very equally. On the scientific/AI side a whole bunch of "20 years away" and "We may never accomplish" have been changed to "now". On the language side things GPT has put any translation service on notice. Summerizers too.
I've never been a crypto fan. I believe there are purposes for it, but at the same time I have a bank that does all the same things.
What I do (did?) not have is an AI that actually solve real life problems that I run into now, and that's something that is both highly useful, and something that many people are willing to pay for.
Again, that's a belief :). Could totally be that they never become a thing, and nobody would be surprised.
It took longer than the likes of Tesla said, but it certainly hasn't been taking longer than a whole lot of people expected.
My prediction is that we're much more than a few years away from it becoming a reality in the way people imagine.
examples?
We haven't even seen a war coming right at us.
My old eyes can't see perfectly anymore, so I would probably miss it - whatever it is - anyway, but if you're so sure, would you bet everything you own on it?
> “[It] revealed an embryo of an electronic computer that it expects will be able to walk, talk, see, write, reproduce itself and be conscious of its existence. Later perceptrons will be able to recognize people and call out their names and instantly translate speech in one language to speech and writing in another language, it was predicted”
The section on "Past Winters" in TFA is a good part of the reason why you might want to not believe what you think you see coming right at us ....
Yes, I know. But there's no way to know if these people are right, right now. That will only be possible to know in the future, looking back, so it's still "predicting the future".
Probably, yes, especially after what happened to Cassandra.
Still a fun counterfactual to develop. Lessee, you do know the future, but do not run your mouth off. Matter of fact, you pooh-pooh any such notion ...
Is this something you can see so clearly that you can describe it in specific terms?
At first we were perplexed by a computer beating Karpov at chess.
These days however we're not perplexed anymore that a lot of creative jobs have been replaced by AI. (I think those people will find another passion no doubt, that is another topic).
Next thing is less creative jobs. But i'm already thinking about climate change and hunger mitigation. You could call me an idealist, only time can tell, of course.
Let people play with GPT 4 for a bit.
but the future is very unclear.
It's obvious at this point that we are figuring out how to create machines that think. While I agree that the future is unclear, in the sense that it's hard to make exact predictions, the trend is very clear. Significant efficiency improvements in many types of intellectual labor is almost certain.
I don't think it's priced in yet; the somewhat independent-minded among tech people are currently the only ones who have front-row seats to what's going on. But in a few years it will be obvious.
Honestly, I think the persistent exponential improvement in AI makes it obvious we're on track for superintelligent machines in a few decades as well (if that!), but the preceding paragraphs should at least be entering the realm of Overton.
* generate digital images from natural language descriptions. ie. DALL-E
* suggest code and entire functions. ie. Copilot
* generate textual content: Generative Pre-trained Transformer. ie. ChatGPT
The future may be in other important endeavors:
* train on ... data and learn how to ... to automate ...
I think that the creativity is in your idea and not in what is being automatically generated.
Edit: That may the lesson of Stable Diffusion: ideas are very cheap, if you have a heuristic for what a good idea is. Generate a business, fix it by optimizing for measurable metrics, if it doesn't work, try again. Legal constraints can be interpreted by an LLM, fines are penalties for training.
I think in terms of human ingenuity, the digital space is finished in the long run. It will all be on the level of infrastructure funneling data to corporations.
The space to innovate with the low-hanging fruit still lies in engineering physical things, where implementation and testing is still a barrier to iterating quickly.
Yes! You’ve mentioned people downplaying, but this is someone who is 95% confident there won’t be an AI winter in the next seven years. That’s really quite confident. And the definition he gave makes it compatible with AI being the biggest thing since sliced bread. But if it gets funded at 3x bread and scales down to 1x bread, that will count.
What cost was this exploration? A blog post? An HN discussion. I think it’s so valuable for people to consider the scenarios they think are unlikely. I find this analysis much more interesting than all the dismissive “my job is safe, AI can’t [friction-point-of-existing-system]” posts. It’s certainly worth the investment of a few hours of work.
If that's the case, I think those, like most people, are taking the advancements seriously. I would say to those people: don't worry too much.
The impact will be big, but it doesn't have to mean people will not have a job anymore, the tools they use will be at another level.
You've made me realize the difference between the arguments I find weak vs strong. The weak argument is I can do something that ChatGPT can't. "I have people skills!". The strong argument is that as ChatGPT grows, I will grow with it.
The AI floodwaters are rising. People are climbing up the stairs when they should be building boats. If you seek shelter and are wrong about how far this goes, your attic will become a coffin.
Mind you, there are always a variety of possibilities that people see, that is true, but this unique flavor of comment is unique because I haven't seen it expressed before. Not during crypto (as others are bringing it up).
It feels like there's a much more serious... insecurity? Maybe that's too aggressive of a word, but it's one that describes how this downplaying partially is rooted in this idea of a replacement, and lack of job security, and an uncertainty about what you should be spending your time on. All of this is so unique, nobody was feeling this way during crypto, not a single person. If you hated crypto, you were hating it because it sounds redundant, the "fans" were annoying, the environmental impact, etc - not a single one of these reasons came from this assumption that crypto will be the new norm.
So I think that's what a lot of the other comments are missing right now. The downplaying feels totally different now. As if even the people who are downplaying realize what's happening, but don't want it to be true.
I did like this blog post though, outside of what we're talking about.
A fair number of HN'ers are the "pull yourselves up by the bootstraps", "We don't need to stinking unions", "Social safety nets are for the weak" types. The potential for AGI causes a cognitive dissonance with them. They are intelligent enough to realize that AGI would nearly completely destroy their ability to make money, but at the same they don't want to release their ideals that "rugged individualism" is why they are better than everyone else, and they would need a more fair system to survive.
Maybe ChatGPT would have suggested that had I ran the comment through it prior instead of sounding like a bumbling fool lol
I'm a crypto and AI optimist, but a tempered optimist. I don't think either tech is imminently going to disrupt everything, but I think both technologies have their use cases. They are far more modest than their most ardent supporters would believe. However, over the course of decades, the tech can transform society, I still think that.
However, as with the internet itself, which never did live up to its loftiest, most optimistic ambitions, it's not to downplay the impact at all. Just thay eventually you do find a point where you grapple with the tradeoffs inherent in the technology and those are often sticky and intractable.
A good reason to consider "what if" is that it's still going to take a lot of effort to get from where we are to where expectations are. There's been many false starts recently: self-driving cars, 3D printing, VR/AR, crypto. 10 years on and they're all real technologies anyone can use and making progress every day, but the wild expectations hit reality. When we get there with AI (and we will, because expectations are a moving goalpost) it's good to have considered what we want to do about it. We don't want to waste years of resources on insurmountable roadblocks, we want ideas about why what worked before stopped and what easier paths forward might exist.
That is, I don't see many people downplaying AI but I do see people with lots of unanswerable questions about how long this current boom will last and where we'll wind up when it's over.
I think Moore’s Law could keep going for decades.[2] But even if it doesn’t...
If 1e35 FLOP is enough to train a transformative AI (henceforth, TAI) system,
which seems plausible, I think we could get TAI by 2040...
Second, power consumption is not improving except by going to 8&16 bit... there's not a lot of room there. Currently, we get <1000GFlOPs/W and even if we get 100x up to 100TFLOPs/W, you still need 10^17kWhr. OK algorithms get us another 10,000x... and it costs $1T to train 1 transformative AI. How many proof of concepts trials will be do at only $100B a pop?
It all just seems a bit flip and hopeful like Feb 2000. The 10^35 number seems like its just pulled out to be a number, when it could orders of magnitude up/dn.
https://www.researchgate.net/publication/354573934_Compute_a...
The 1e35 FLOP number is meant as a conservative upper bound and comes from here: https://www.lesswrong.com/s/5Eg2urmQjA4ZNcezy/p/rzqACeBGycZt...
The major fabs all have roadmaps for approaching 1 nm, and there are other advances that could allow you to keep going either if transistor size scaling stops (e.g., vertical scaling). (That said, I definitely don't think it's a given that HW price-performance keeps doubling at the same rate 10+ years.)
5-7 years ago the progress with self driving cars seemed enormous, and the end of driving was just around the corner. And then all progress seemed to stall or recede, and it turned out that what seemed like huge progress was mostly hot air.
Maybe that’s not what happening now, but I don’t think a cautious approach is unwarranted.
Yep, but a lot of the current hype for GPT is that we're in the near-vertical segment of the sigmoid, and so people are like "woah, if that's where we are now, where will we be in 5-10 years?!". And the answer to that might be, pretty much where we are now. And maybe not, maybe it'll be better, but you can't assume linear improvements on a sigmoid curve.
In theory if we could make multi-modal GPT-4 go very fast, we could have it operate a car right now. It's too bad we don't have access to feed it images, because my guess is if you put a picture of an inside of the car and showed a kid chasing a ball into the road in front of it, it's first guess would be "hit the brakes".
- Redundant due to winner takes all dynamics. - Useless - Way to expensive for what it does. - Produced off of sky-high seed rounds at 150 MM.
This same dynamic happened with the www leading to an eventual crash - the mobile and social versions would have been more noticeable had it not happened in private markets and simultaneously with the valuation spike of the late teens. It would be almost more surprising if there wasn't a pull back eventually.
This also doesn't say anything about the people who work in AI. It's not a given that the legions of research scientists populating corporate labs will be the right people for new startups. Similarly it may turn out that prompt engineering is the dominant method for talking to LLMs rather than code.
ChatGPT, at least for GPT-4, can already be considered as someone coined, baby AGI. It is already practical and useful, so it HAS to be REAL.
If it is already REAL, there is no need for another winter to ever come to reap the heads of liars. Instead AI will become applied technology, like cars, like chips. It will evolve continuously, and never go away.
It's crazy impressive but that's not 0.00001% of an AGI.
But there will be a small transformation:
* More busy work will be automated taking away some of the fun and leaving the harder tasks thus making jobs shittier, pushing workers to find other kinds of work.
* More solutions on AI looking for problems will be implemented increasing the speed of success/failure, and from the lottery winner effect we can expect "the granny that created an AI solution and earned millions" that other devs will follow and fail leaving debts.
Since when is busy work fun and hard tasks shitty?
It's very likely we'll be disappointed with AI in many oversold contexts (I share the sentiment about self-driving cars), but it can't be denied that ChatGPT is a product that's being used _right now_ to massive success and still has quite a ways to go.
Large decisions such as SVB deposits are literally the last thing that will be given to AI, it's the most important part of the business. That doesn't mean AI is useless or is not being incorporated into valuable parts of businesses.
I'm at a large tech company, LLMs are already entering some of our key product workflows. It massively lowers the floor for a number of product features e.g. recommendation systems.
In a more general sense, many features that were previously too difficult to expose (e.g. simple coding commands) to business users are now on the table as long as we give them limited access to an LLM. The current hype train means that we don't even need to do much user education.
If crashing a self-driving car required me to spend 5 minutes rejiggering it, I'd probably use the feature a lot. With generative models there's usually very little cost to it making a mistake -- and even better, I can determine when the cost is likely to be high and modify my behavior.
Self-driving cars do seem much better than they used to be. But I have no interest in using them until they get better still. I don't have this same bar with LLMs or DALL-Es. And I think this will contribute to more continuous improvement in the technology.
And then it did.
After the dotcom bubble exploded. Can't we call that a winter?
Was there a massive reduction in completely untenable .com's? But I'm not exactly sure if that's the definition of a winter, plenty of other internet based businesses did fine and kept growing in that time.
You can absolutely build high precision ML models. Using a transformer LM to sum numbers is dumb because the model makes little assumptions about the data by design, you can modify the architecture to optimize for this type of number manipulation or you can change the problem to generating code for summing values. In fact Google is using RL to optimize matmul implementations. That’s the right way of doing it.
The past AI winters have been preceded by periods of AI moving forward faster than anticipated. Its when the limits of easy advancement with the current approaches are reached without a new approach that allows continued rapid progress you get an AI winter.
Why?
And what is a "user" when it comes to ChatGPT and it's ilk? How does that compare with the definition of a user of, say, the web? Or of SMS ?
Buy the other side of physical infrastructure is already here. The internet, cellphones, and computers already exist in mass and can be utilized by AI now. We didn't need to build new highways for this. No new towers. No wires put in the ground. Those fields already exist and are ready for planting.
given that they need a _huge_ amount of GPU power to server that kind of traffic, I suspect that 100million seems out by an order of magnitude.
If advancing means ever larger and more expensive systems and ever more data, we will enter a cold winter soon.
Energy is "probably" not a big deal. If you're looking at long term oversupply from green energy sources, it's probably not hard to train with bursty, but very cheap power like this.
Compute is currently the biggest limitation, and will remain so far a long time, as long as scaling continues.
Calling it now: humanity will seal its fate the day we hook up LIGO to ChatGPT and it gets corrupted by gravitational waves from the beginning of time when the Great Old Ones freely roamed the universe.
The next step is multi-modal data. Think videos, sounds, touch, etc.
An 18 year old in fact "trained" on much more input data than GPT4, orders of magnitudes more, considering the complete informational content of our 5 senses and implicit structure of our brains "learned" through evolution.
Not to mention recent research in LLM scaling (chinchilla) reveals how our current models are undertrained and over-parameterized.
We have not plateaued yet.
Remember that the data must be annotated. This puts limits on what can be usefully ingested.
And
>Take for example the sorting of randomly generated single-digit integer lists.
These seem like very confused statements to me.
For example, lets take banking. It's actually two (well far more) different parts. You have calculating things like interest rates and issues like 'sorting integers' like above. This is very well solved in simple software at extremely low energy costs. If you're having your AI model spend $20 trying to figure out if 45827 is prime, you're doing it wrong. The other half of banking is figuring out where to invest your money for returns. If you're having your AI read all the information you can feed it for consumer sentiment and passing that to other models, you're probably much closer to doing it right.
And guess what, ask SVB about 99% correct correct solutions that do/don't capture value. Solutions that have correct answers are quickly commoditized and have little value in themselves.
Really the most important statement is the last one, mostly the article is telling is the reasons why AI could fail, not that those reasons are very likely.
>I still think an AI winter looks really unlikely. At this point I would put only 5% on an AI winter happening by 2030, where AI winter is operationalised as a drawdown in annual global AI investment of ≥50%. This is unfortunate if you think, as I do, that we as a species are completely unprepared for TAI.
Two years ago was an opinion piece from NIST on the impact optoelectronics would bring specifically to neural networks and AGI, and watching as nearly every major research institution has collectively raised probably half a billion for AI photonics plays through their VC partnerships or internal resource allocations on the promise of order of magnitude improvements much closer than something like quantum computing, I think we really haven't seen anything yet.
We're probably just at the very beginning of this curve, not approaching its diminishing returns.
And that's both very exciting and terrifying.
After decades in tech (including having published a prediction over a decade ago that mid 2020s would see roles shift away from programming towards emergence of specialized roles for knowing how to ask AI to perform work in natural language) I think this is the sort of change so large and breaking from precedent we really don't know how to forecast it.
I am not speaking speculatively either. I have seen it happen finetuning ESRGAN on previous upscales that I even personally vetted as "good," and these generative models are way more sensitive than the old GANs.
More than that, I believe we will hit a ceiling when the impossibility of these models to incorporate causality becomes evident.
Right now, LLMs are trained by predicting the next word given a context (the prompt). This approach, IMHO, gives a resemblance of cause/effect because the training data is made by humans and obviously we are able to express ourselves and reason in those terms. So we have a poor proxy for that which, also IMHO, partially explains why LLMs performance degrades when asked to solve novel problems (there was an entry few days ago about this).
1) langchain paper? 2) reasoning paper?
Thanks!
So yes, easy data scaling is coming to an end and may or may not lead to a short term winter. But this also means that, all being equal, training a model will be cheaper compared to a situation where we still had orders of magnitude more data to go.
The specific problem was what while I'm in a WebSocket handler, I cannot await on asynchronous generators which act like `asyncio.sleep()` and send messages to the client while I have `heartbeat` on that `WebSocketResponse` enabled (it sends pings to the client and waits for pongs to see if the connection is "alive"). The issue is that the incoming pong is not getting processed so the client gets disconnected.
I struggled a lot with ChatGPT's help, but it was mostly insightful, like rubberducking with a duck that does actually try to help you.
Occasionally I went to Google to search for a very specific way of solving the issue; for me Google is the gateway to Stack Overflow, I never use Stack Overflow's search.
But I didn't find anything of value there. And earlier today I noticed that I had unread messages in Stack Overflow, and when I checked how many consecutive days I have been on SO: 1. I used to be 100+ consecutive days on SO and lately I'm struggling with using it as the to-go place for my programming questions.
And this is where your comment comes in: I was thinking to myself what is going to happen if more people move away from Stack Overflow, that place is a goldmine of programming information, who will feed it?
One thing I really hope is that OpenAI adds some "modes", like what were poised to expect from Copilot X, where we get different layouts for the webpage, so that we can choose a "programmer mode" which actually lets us give proper feedback in the sense that "this code worked", "that one didn't".
There's already a feedback, but it's not task-oriented. A programmer can submit to it as well as a cook, the result won't go into a "database of usable code" which ideally would be publicly accessible or even get formed into a Question/Answer pair which is prepared to be submitted to Stack Overflow.
Stack Overflow will degrade to single search box. And we'll all love it.
- What really happens in corporate/government/private decision-making?
- Did a particular politician really trade his vote for money? How was that done?
- Are elected judges better/more honest than appointed judges?
- Are there hidden organizations within particular governmental entities? e.g., a right-leaning group within the FBI who secretly persecutes persons/groups of other political persuasions? Are there independent entities within the CIA that are capable of financing and operating on their own under the umbrella of the government but also capable of evading the congressional oversight specified in the Constitution?
- Is my wife's cousin really screwing Hunter Biden again?
It's going to shift from requiring quality data to producing quality data.
There is not going to be need for it just like there is no need for more Kasparovs anymore.
You can see it with artists slowly happening.
Lawyers will get the hit (or great tool to use depending how you want to see it).
Medical analysis will find the same faith. If you think that medicine will require human analysis just imagine for a second what closed loop AI could do - if it had access to data not only from all hospitals but patients as well and being able to munch through it continuosly. This together with constant access to simulations and physical trials, finding patterns and correlations on its own.
It's exciting and depressing to think that humans will evantually be left to being humans the way they wish with everything sorted out - just like chickens don't mind being free range chickens.
There is no other direction it can go and it'll just go faster.
Our generation will see some mind blowing things.
Next generation will arrive at the world unlike anything else.
synthetic data gives you synthetic results.
To train something requires decent quality input, otherwise it's going to mimic the crap quality stuff. There is little chance in getting around that.
Have you ever stopped to wonder _why_ large for profit companies give away free models with weights? its because once trained, they are commodity. the hard part is dataset management.
Yes, chatgpt is largely self supervised, but the training into a usable model required a fucktonne of human hours
I think the current crop of AI is good enough. It will happen because people will actually grow resentful of things that AI can do.
I anticipate a small, yet growing segment of populations worldwide to start minimizing internet usage. This, will result in fewer opportunities for AI to be used and thus the lack of investment and subsequent winter.
When this happened in the 60s-70s, the psychedelic revolution was crushed by the government. And we entered an AI winter.
I’m not implying causation. Just pointing out a curious correlation between the two things.
I wonder what will happen now.
See https://digital-strategy.ec.europa.eu/en/policies/regulatory... for the rationale and general approach.
The text in itself won't be that interesting, the magic happens once you essentially train three different token predictors, one that predicts image tokens (16x16 pixels) and then combine that to predict video frames, one that predicts audio tokens and one that predicts text tokens. Then you use cross-attention between these predictors. To train this model you first pre-train the text predictor, after that's done you continue training the text predictor from the transcribed videos, while combining it with the video predictor and audio predictor with cross-attention.
Such a model will understand physics and actions in the real world much better than GPT-4, combined with all the knowledge from all the text on the internet it should turn out to be something quite interesting.
I think there probably doesn't exist enough compute yet to train such a model on something like all of YouTube, but I wouldn't be surprised if GPT-5 is a first step in this direction.
https://pluralistic.net/2023/01/21/potemkin-ai/
It will massively increase the value of human interaction ... and the cost.
It may even go so far that actual professionals start hiding from the internet, to hide from these models and avoid enshittification that way. We may have to start going back to a visiting a local cafe to find a plumber.
I don't even think that is such a bad thing.
Any AI that wants to actually learn more than just language (from summarization to bullshitting) will need to take actions in the real world and learn from them.
Well, that's one additional source of knowledge, but we haven't even got into other sources like voice, video, simulation data, etc (let alone the interesting stuff like financial market data, aggregate human behavior, etc, etc). GPT-4 is only just starting to support image data, and who knows what GPT-5, 6.. will bring. Robotic embodiment is maybe better thought of as robotics, not an necessity for advancing AI in dozens of useful ways.
But of course not every AI needs to be an expert in every domain. If you want to build a robot then it'll need to learn via interaction, but there's are tons of applications for even these 1st-gen language-only systems - look at all the applications that people have already found for them, and what is starting to be done with LangChain and plugins.
We can do better. All we have to do is be constructive when we write narratives about LLMs.
Unfortunately, that's hard work: we basically have to start over. Why? Because every narrative we have today personifies LLMs.
It's always a top-down perspective about the results, and never about how the actual thing works from the ground up.
The reality is that we never left AI winter. Inference models don't make decisions or symbolically define subjects.
LLMs infer patterns of tokens, and exhibit those patterns. They don't invent new patterns or new tokens. They rely entirely on the human act of writing: that is the only behavior they exhibit, and that behavior does not belong to the LLM itself.
We should definitely stop calling them AI. That may be the category of pursuit, but it misleadingly implies itself to be a descriptive quality.
I propose that we even stop calling them LLMs: they model tokens, which are intentionally misaligned with words. After tokenization, there is no symbolic categorization: no grammar definitions: just whatever patterns happen to be present between tokens.
That means a pattern that is not language will still show up in the model. Such a pattern may be considered by humans after the fact to be exciting, like the famous Othello game board study, or limiting, like prompts that circumvent guardrails. The LLM can't draw any distinction between grammar-aligned, desirable, or undesirable patterns; yet that is exactly what most people expect to be possible after reading about a personified Artificially Intelligent Large Language Model.
I would rather call them "Text Inference Models". Those are the clearest descriptors of what the thing itself is and does.
The entertainment industry disagrees with this.
These systems are transformative for any creative works and in first world countries, this is no small part of the economy.
The avengers if they had 90's actors is going viral.
https://cosmicbook.news/avengers-90s-actors-ai-art
Also the avengers as a dark sci fi https://www.tiktok.com/@aimational/video/7186426442413215022
AI art and generative text is just astounding, and it's only getting better.
I think the rather breathless posts (which I also remember from the 80s and apparently used to be common in the 60s when computers just appeared) will die down as the limits of the LLMs become more widely understood, and they become ubiquitous where they make sense.
In which case progress becomes unlimited and there’s never an AI winter again.
Of course, there's a bubble, but after that bubble pops, people will realize that current models are useful enough, even with their quirks. People all have quirks and mostly they get along, so they will accept quirks from machines. Anthropomorphizing machines will help accepting models. I know, this is dangerous, but I have this mental image: a doll in form of a seal baby with soft white fur with a Whisper model helping lonely handicapped people (note that I myself am a person with a disability, so don't cancel me, please). Or someone who technically is not very adept phoning for support and a Whisper model helping along and having a lot of time to chit-chat.
And technically I think, something will happen in about five years. A new floating number format, the posit (https://spectrum.ieee.org/floating-point-numbers-posits-proc...), is too useful to be ignored. It will take years because we need new hardware. Why do I think that posits are very useful? Posits could encode weights using very little storage (down to 6 bit per weight). Models perhaps need to be retrained using these weights because 6 bits are not precise. After all, you have only 64 different values. And I think with the new hardware supporting posits they will also have more memory for the weights. Cell phones will be able to run large and complex models efficiently. In other words, Moore's law is not dead yet. It just shifted to a different, more efficient computation implementation.
When this happens, immediate feedback could become feasible. With immediate feedback we do another step to achieve AGI. I could imagine that people get delivered a partially trained model and then they have a personal companion helping them through life.
or a personal cop/political commissar for every citizen
I was under the impression that the size and quality of the training dataset had a much bigger impact on performance versus the sophistication of the model, but I could be mistaken.
Compute is then proportional to the product of model size & data quantity.
That said, quality of data also matters a lot - OpenAI has had human labelers produce the data for their Reinforcement Learning from Human Feedback (RLHF), which has probably had a disproportionate impact on the success of ChatGPT compared to previous models, but that data is probably O(1%) of what they trained on.
At this point I'm guessing OpenAI are limited by both data & compute. Rumor has it they're training the "next big thing" now and it won't finish until December. If they had more compute they could presumably finish sooner, and if they had more data they would presumably let it train longer.
But a lot of the advancements we're seeing right now are the result of more sophisticated models [1], and one person is doing some interesting work [2] around achieving transformer-level performance with other architectures.
So it's not completely settled if more data is the answer. But it has a significant impact.
[0] https://ai.facebook.com/blog/large-language-model-llama-meta...
[1] https://en.wikipedia.org/wiki/Transformer_(machine_learning_...
Babies do something completely different. They can't walk when born. Their model is to blunder about and work things out, building the model up thro a can I do this - can I do that - why not etc. Its only through this doing learning happens.
We have calf ai right now..you ask the calf what do you want to learn next or what are you curious about and you get to see how dumb it is.
The AI generators work similarly. They're like slot machines, literally built on random number generators. If you don't like the result, try again. When you get something you like, you keep it. There are diminishing returns to re-running the same query once you got a good result, because most results are likely to be worse than what you have.
Randomness can make games more fun at first. But I wonder how much of a grind it will be once the novelty wears off?
I hold it up against the response I would expect from a human and in a lot of cases I’m not sure the human wins.
LLMs - OpenAI, Google Brain, Meta FAIR, HuggingFace and others are now routinely training models with the entire corpus of the internet in a few months. The models are getting larger and more efficient.
Diffusion models - MidJourney, StableDiffusion, Dall-E and it's control net cousins - Trained on terabytes of images, almost entire corpus of internet.
Same with voice and other multimodal models.
The transformer algorithm is magical but we're just getting started.
There are now multiple competing players who can drop millions of dollars on compute and have access to internet sized datasets.
The compute, the datasets, the algorithms, the human reinforcement loops, all are getting better week over week. Millions of users are interacting with these systems daily. A large subset even paying for it.
There is the gold rush.
in the late 90s and early 2000s, neural network had a significant stigma for being dead ends and were unpromising grads were sent - people didn't want to go there because it was a self-fulfilled prophecy that if you went to research ANNs then you were a loser, and you were seen as such, and in academia that is all you need to be one
but, in real life, they worked
sure, not for everything because of hardware limitations among other things, but these things worked and they were a useful arrow in your quiver as everybody else just did whatever was fashionable at the time (simulated annealing, SVMs, conditional random fields, you name it)
hype or no hype, if you know what you are doing and the stuff you do works, you will be okay
Silicon Valley Tech is already promising that AI will be the likely solution to climate change..., if there is any more disruption to the economy it's just going to yet again slow down mitigation steps for climate change, thus having negative affects on the amount of capital available for these projects.
Printing money works, until it doesn't.
AI: Stop building me, I take up far too many resources and generate way too much heat.
If there isn't a winter, will ChatGPT et al be able solve the energy crises they might be implicated in? Is there something in its magic text completion that can stop global warming? Coming famines?
Is perhaps the fixation on these LLMs right now, however smart and full of Reason they are, not paying the fullest attention to the existential threats of our meat world, and how they might interfere with what ever speculative dystopia/utopia we can imagine at the moment?
I think it’s unlikely, but no less likely than the compute issues mentioned.
This isn't like the manhattan project. There are lots of people who know how to make this stuff, and they don't need rare volatile elements - just consumer hardware.
And no, the big models require exabytes of processing power and time, so at least at the most extreme scales if nations started punching missiles in processor factories and data centers you'd slow top end AI projects way down.
Yeah, but we weren't. We were talking about chatgpt and llms.
Of course if the singularity arrives, all bets are off, all dominoes will topple, and the new world order will be hard to guess, if there even is one.
If Russia and China think the US is about to have AI capable of absolute total global domination they may launch a preemptive strike. Maybe hypersonic cruise missiles at datacenters, maybe a full EMP or nuclear launch.
(Swap countries around as desired.)
The Corporate desire for profit will overshadow the livelihood of billions. It's been this way in the US since forever. Look what happened to the corporation that caused the Opioid epidemic. Nothing, they profited.
Then what do you want me to say? It's the truth. There are always exceptions. Always. You want me to say you're right when you're actually wrong?
> but Norway and Denmark are
You kidding? Scandinavia is more or less a collection of countries closest to socialism. These countries have by far more regulations in GENERAL. It's obvious but we can find evidence if you want. Take this for instance: In Sweden, there is a law enforcing a five-week vacation policy.
>The US has already demonstrated the ability to regulate a specific technology--namely nuclear energy--to a point where it is almost completely marginalized. So the notion that the US isn't capable of regulating an entire technology into near-oblivion is demonstrably false.
Except there are multitudes of failures as well. The failures outnumber the successes by a huge margin. Take for instance:
Enron: In the early 2000s, the energy company Enron engaged in a series of fraudulent accounting practices to make it appear as if the company was more profitable than it actually was. Despite warnings from whistleblowers and others, the government failed to intervene and the company ultimately collapsed, resulting in significant financial losses for many investors and employees.
BP Oil Spill: In 2010, an explosion on an oil rig operated by BP in the Gulf of Mexico caused the largest oil spill in U.S. history. The disaster was largely attributed to lax regulation and oversight by government agencies, including the Minerals Management Service.
Volkswagen: In 2015, it was revealed that Volkswagen had installed software in its diesel cars that cheated emissions tests, leading to higher levels of pollution than were reported. The company ultimately agreed to pay billions of dollars in fines and compensation, but the government was criticized for failing to catch the deception sooner.
Equifax: In 2017, the credit reporting agency Equifax suffered a massive data breach that exposed the personal information of millions of people. Critics argued that the government had not done enough to regulate the company and protect consumer data.
Tobacco Industry: For decades, the tobacco industry engaged in deceptive marketing practices that downplayed the health risks of smoking. Despite mounting evidence of the harmful effects of tobacco, the government was slow to take action to regulate the industry, and it was not until the late 1990s that significant reforms were implemented.
Wall Street: The 2008 financial crisis was largely caused by the reckless behavior of major Wall Street banks and financial institutions. Many critics argue that the government failed to adequately regulate these institutions, allowing them to engage in risky practices that ultimately led to the collapse of the housing market and the wider economy.
Boeing: In 2019, two deadly crashes involving the Boeing 737 Max raised questions about the safety of the aircraft and the company's regulatory oversight. Critics argued that the FAA (Federal Aviation Administration) had been too close to Boeing, allowing the company to cut corners and prioritize profits over safety.
Big Pharma: The pharmaceutical industry has come under scrutiny for a variety of reasons, including skyrocketing drug prices, aggressive marketing tactics, and the opioid epidemic. Critics argue that the government has not done enough to regulate the industry, which has resulted in significant harm to patients and communities.
Meatpacking Industry: The meatpacking industry has been criticized for unsafe working conditions, low wages, and lax regulatory oversight. The COVID-19 pandemic brought these issues to the forefront, as workers in meatpacking plants became some of the hardest hit by the virus.
Tech Industry: Tech giants like Facebook, Google, and Amazon have faced criticism for a variety of reasons, including antitrust violations, privacy violations, and the spread of misinformation. Critics argue that the government has not done enough to regulate these companies, which have become some of the most powerful corporations in the world.
Fast Food Industry: The fast food industry has been criticized for its low wages, poor working conditions, and contributions to obesity and other health problems. Critics argue that the government has not done enough to regulate the industry, allowing companies to prioritize profits over the well-being of workers and consumers.
Industrial Agriculture: Industrial agriculture has been criticized for its negative impacts on the environment, animal welfare, and public health. Critics argue that the government has not done enough to regulate the industry, allowing companies to engage in practices that harm people and the planet.
Gun Industry: The gun industry has come under scrutiny in recent years, following a series of mass shootings in the US. Critics argue that the government has not done enough to regulate the industry, which has contributed to the proliferation of firearms and the high rate of gun violence in the US.
Pharmaceutical Industry: The pharmaceutical industry has been criticized for a variety of reasons, including the high cost of drugs, the influence of drug companies on medical research, and the opioid epidemic. Critics argue that the government has not done enough to regulate the industry, allowing companies to prioritize profits over the well-being of patients.
Big Oil: The oil and gas industry has been criticized for its contributions to climate change, its negative impacts on local communities and the environment, and its outsized influence on politics. Critics argue that the government has not done enough to regulate the industry, allowing companies to continue to engage in practices that harm people and the planet.
Private Prisons: Private prisons have been criticized for their poor conditions, lack of accountability, and their contribution to mass incarceration. Critics argue that the government has not done enough to regulate the industry, allowing companies to profit from locking people up.
Airlines: The airline industry has been criticized for its treatment of passengers, including overbooking flights, delays, and cancellations. Critics argue that the government has not done enough to regulate the industry, allowing companies to prioritize profits over the comfort and safety of passengers.
Plastic Industry: The plastic industry has been criticized for its contributions to pollution and environmental degradation. Critics argue that the government has not done enough to regulate the industry, allowing companies to continue to produce single-use plastics and other products that harm the planet.
Financial Services Industry: The financial services industry has been criticized for its high fees, predatory lending practices, and the exploitation of vulnerable populations. Critics argue that the government has not done enough to regulate the industry, allowing companies to prioritize profits over the well-being of customers.
Gig Economy: The gig economy, which includes companies like Uber and Lyft, has been criticized for its treatment of workers, including low wages, lack of benefits, and a lack of job security. Critics argue that the government has not done enough to regulate the industry, allowing companies to exploit workers in the pursuit of profits.
It’s disingenuous to make an overly general statement and then immediately dismiss any counterexample to that overgeneralization by saying “there are always exceptions”. I could just as easily say the United States is chronically overregulated and your list of examples are the exceptions.
Where did you get that by the way? I can’t find any exact phrase matches online, and the writing style and overall glib superficiality reminds me of ChatGPT output. I’m not going to waste my time rebutting machine-generated garbage point by point, especially when half of it is meaningless weasel language about what “critics argue”.
Ultimately it doesn’t matter because if there are exceptions either way, then it’s still possible AI will be regulated.
> You kidding? Scandinavia is more or less a collection of countries closest to socialism.
A common misconception. In reality, they are market economies that combine a dynamic free market economy with a generous welfare state. Wikipedia even specifically lists as a characteristic of the “Nordic model”, “Little product market regulation. Nordic countries rank very high in product market freedom according to OECD rankings”(https://en.m.wikipedia.org/wiki/Nordic_model). It also mentions this quote:
In a speech at Harvard's Kennedy School of Government, Lars Løkke Rasmussen, the centre-right Danish prime minister from the conservative-liberal Venstre party, addressed the American misconception that the Nordic model is a form of socialism, which is conflated with any form of planned economy, stating: "I know that some people in the US associate the Nordic model with some sort of socialism. Therefore, I would like to make one thing clear. Denmark is far from a socialist planned economy. Denmark is a market economy."
> Given the sheer amount of counter examples of lack of regulation. It's pretty much safe to say that it's highly unlikely AI will be regulated in any meaningful way.
So then how do you explain the regulatory crippling of nuclear power?
I got it from my notes for an unrelated project. You can't find it because I wrote the notes. But this shouldn't matter. As long as the points are correct, you getting schooled by an AI is irrelevant to the conversation at hand.
>It’s disingenuous to make an overly general statement and then immediately dismiss any counterexample to that overgeneralization by saying “there are always exceptions”.
No it's not. General truths exist. You must dismiss exceptions to get at the general truth. Otherwise we'll be mired in details constantly.
>Denmark is a market economy.
I never said it wasn't. I said "closest" to a socialist economy.
>A common misconception. In reality, they are market economies that combine a dynamic free market economy with a generous welfare state.
No misconception made here. You are putting words in my mouth. I said it was closest to socialism. And it holds true. A generous welfare state is closer to socialism.
>The Heritage Foundation publishes an “Economic Freedom Index” that ranks countries by “economic freedom”, according to their own conservative, pro-free-market point of view, and they rank Denmark and Sweden as more economically free than the United States
That's bullshit. The heritage foundation is a conservative think tank with a biased agenda. How about getting a study from an unbiased source. "Economic Freedom Index" << don't fall for that.
Check out which countries rank the highest for food regulations: https://www.fooddocs.com/post/food-safety-standards
The US isn't even on that list because we've lobbied the hell out of those laws to be lax af.
Not to mention labor regulations, mandatory five week vacations? Paternity leave? Unheard of in the US.
Just use some common sense before trusting some "Freedom" Index from a politicized foundation.
>So then how do you explain the regulatory crippling of nuclear power?
It's an exception. I mean I literally gave you tons of examples how the US fails to regulate things. The ratio of failures to successes is what matters here. And the failures outnumber the successes by a huge amount. I only copied a fraction of my notes. Would you like more?
The points don't specifically pertain to the US and have enough garbage weasel words that they don't even rise to the level of "correct". I'll make another comment that goes through them though.
> General truths exist. You must dismiss exceptions to get at the general truth. Otherwise we'll be mired in details constantly.
You can't just handwave away complexity. It's entirely possible for the US to have too little regulation in some fields and too much regulation in other fields.
Your claim is that it's impossible for the US to erect regulatory barriers for AI. Whether or not the US, in general, has more or less regulations than other countries isn't sufficient to make that case.
> The heritage foundation is a conservative think tank with a biased agenda.
I never claimed otherwise. But why would a conservative think tank, which favors less business regulations, not even put the US on the top ten list of most "economically free" countries if the US is so underregulated? Why would they prefer the regulatory environment in Denmark and Sweden over the regulatory environment in the United States?
> Check out which countries rank the highest for food regulations
So when I bring up examples they're "exceptions", but while you bring up examples, they're examples of the rule. When I cite sources that do an overall survey of a country's regulatory environment, that's "biased", but when you cite a source that makes their money by helping companies comply with food regulations, that's just fine.
> Not to mention labor regulations, mandatory five week vacations? Paternity leave? Unheard of in the US.
Yeah, there are some places where the US has more regulations and some places where the US has less regulations.
If we're talking about regulating AI, I think nuclear energy regulations are a much more analogous case than vacation and paternity leave.
> It's an exception. I mean I literally gave you tons of examples how the US fails to regulate things. The ratio of failures to successes is what matters here. And the failures outnumber the successes by a huge amount. I only copied a fraction of my notes. Would you like more?
I can run ChatGPT myself, thanks. Why don't you try thinking for yourself and considering the possibility that your presuppositions are wrong?
I didn't handwave anything. My answer is sufficiently complex with multitudes of counter examples to your point.
The whole thing with the massive list of examples is to illustrate a general point on the lack of business regulation overall in the US.
I literally stated it's the ratio of failures to successes that matters here. If I can produce 30 examples of the US failing to regulate and you produce one, that speaks to an overall generality that eclipses your example.
The arena of scientific validation is hard to establish here. Neither of us can paint a picture of the entire domain of every single failure and success of regulatory laws in existence for the US. So given the nature of this debate just list as many general examples as possible.
You have nuclear power as one, that's it.
>I never claimed otherwise. But why would a conservative think tank, which favors less business regulations, not even put the US on the top ten list of most "economically free" countries if the US is so underregulated? Why would they prefer the regulatory environment in Denmark and Sweden over the regulatory environment in the United States?
Don't know. The motivations of such groups are complex and multifaceted. Following some breadcrumb trail to get at the root of it is too much effort. I only know that this group is biased and not a neutral party. There's no point in vetting a known compromised source. Pick a valid one.
>So when I bring up examples they're "exceptions", but while you bring up examples, they're examples of the rule. When I cite sources that do an overall survey of a country's regulatory environment, that's "biased", but when you cite a source that makes their money by helping companies comply with food regulations, that's just fine.
Yeah you cited one bogus example from the heritage foundation. All my examples are real. Unlike yours.
>I can run ChatGPT myself, thanks. Why don't you try thinking for yourself and considering the possibility that your presuppositions are wrong?
Highly disagree. Your answers are inferior to anything chatGPT can come up with so obviously you likely can't run it yourself.
Your list produces nothing of the kind, as I tediously went out of my way to demonstrate.
> I only know that this group is biased and not a neutral party. There's no point in vetting a known compromised source. Pick a valid one.
You haven't provided any valid sources yourself.
> Highly disagree. Your answers are inferior to anything chatGPT can come up with so obviously you likely can't run it yourself.
Well, that's just your opinion, and it's an opinion that reflects more on your poor judgment than on me.
> Enron: In the early 2000s, the energy company Enron engaged in a series of fraudulent accounting practices to make it appear as if the company was more profitable than it actually was.
And in 2002, the US passed the Sarbanes-Oxley Act, which dramatically increased the regulatory burdens of running a publicly traded company.
> Volkswagen: In 2015, it was revealed that Volkswagen had installed software in its diesel cars that cheated emissions tests, leading to higher levels of pollution than were reported.
This doesn't make the point you think it makes. Even though Volkswagen is a German company that were selling these cars all around the world, and even though 8.5 million of the 11 million Volkswagens that were eventually recalled were in the European Union, it was the US EPA, not European regulators, who caught Volkswagen.
> Tobacco Industry
Almost all European countries have higher smoking rates than the United States. France has twice as many smokers as the US.
> The 2008 financial crisis was largely caused by the reckless behavior of major Wall Street banks and financial institutions. Many critics argue that the government failed to adequately regulate these institutions, allowing them to engage in risky practices that ultimately led to the collapse of the housing market and the wider economy.
"Many critics argue"--there are those weasel words again. Similarly with Enron, this led to the Dodd-Frank Act, which increased financial regulations again.
An interesting counterpoint to this is the Libor scandal, which came to light a few years afterwards. (https://en.wikipedia.org/wiki/Libor_scandal) Similarly to Volkswagen, the Libor scandal was happening in Europe (specifically the UK) under European regulatory jurisdiction, and yet it was American regulators who caught the perpetrators.
> Boeing 737 Max
This is a case of US regulators being behind other countries, but it is an exception. Also note that none of the actual 737 Max crashes happened in the US, but rather in countries with weaker regulatory regimes when it comes to airline operations.
> Big Pharma
Not US specific. Lots of these firms, like Bayer and GSK, are European, and drugs usually get approved by European regulators more quickly than they get approved by the FDA.
> Meatpacking Industry: The meatpacking industry has been criticized for unsafe working conditions, low wages, and lax regulatory oversight.
Meaningless weasel words.
> Tech Industry: Tech giants like Facebook, Google, and Amazon have faced criticism for a variety of reasons, including antitrust violations, privacy violations, and the spread of misinformation. Critics argue that the government has not done enough to regulate these companies, which have become some of the most powerful corporations in the world.
Weasel words. If you want to count this as US specific because most of these companies are American, then you don't get to blame the US for the actions of Volkswagen and British Petroleum.
> Fast Food Industry: The fast food industry has been criticized for...
More weasel words. Also not US specific.
> Industrial Agriculture
Not US specific.
> Gun Industry
Unrelated political controversy.
> Pharmaceutical Industry
You already listed Big Pharma.
> Big Oil
Not specific to the US. Canada and Norway also produce oil, and relative to their GDP, they are more dependent on oil production than the US is. In yet another example of US regulations being more stringent than other countries, it was the US, not Canada, that shut down the Keystone XL oil pipeline between Canada and the United States.
> Private Prisons
Also not US specific. Australia, New Zealand, and Canada have more of their prisoners in private prisons than the US does.
> Airlines, Plastic Industry, Financial Services Industry
Still not US specific and still full of "critics argue" weasel words instead of actual facts.
> Gig Economy: The gig economy, which includes companies like Uber and Lyft
I'mma stop you right there because Uber and Lyft were created to circumvent onerous taxi regulations that led to poor customer service, poor availability, and high prices.
But when they, together with environmental activists, were able to get laws passed that drastically increased the cost of running a nuclear plant the regulators couldn't say no. So their costs increased, but then their profits increased as well through the magic of cost-plus contracts.
There are too many single source suppliers in the chain up to EUV lithography. We may in fact be at peak IC.
Of course there hasn't been much increase in single core clock speeds or cost reduction for a while now (certainly nothing from Intel), but TSMC and Samsung do continue to make progress, with multiple future process generations under development.
As far as AI, or more specifically training (and running) massive neural nets, it's not single core performance that matters at all - it's all about specialized matrix multiplication hardware whether NVidia's Tensor Cores or Google's TPUs, and more importantly the ability to bring many of these specialized units together to work on a single problem. Distributed NN training has been a solved problem for a long time, with things like GPT-4 being trained across 10,000 machines.
This type of massive parallelism can continue to grow regardless of what is happening to Moore's law and single core performance.
Our ability to make high end chips may plato due to a complete inability of AMSL to source all the parts for EUV steppers.
Many of those components themselves have multi-national supply chains.
I'm surprised that the US didn't consider tech self-reliance as a national security issue a long time ago.
If they effectively shut out other hardware companies, that is going to slow scaling and price/perf reduction.
Foreign nations aren't going to be happy about one mostly US company holding all the cards too.
In the meantime we've got LangChain showing what's possible when you give systems like this a chance to think more than one step ahead ...
I don't see an AI winter coming anytime soon... this seems more like an industry changing iPhone or AlexNet moment, or maybe something more. ChatGPT may be the ENIAC of the AI age we are entering.
pray for a winter but prepare for a societal upheaval
The winter before the AI winter will consist in all the cheap data disappearing. What fun will it be to write a blog post so that it can be scraped by a bot and regurgitated without attribution? Dito for code
Or, how will info sites survive without ad revenue? Last I checked bots don't consume ads
When the internet winter comes, all remaining sites will be behind login screens and a strict ToS popup
That said, I don't think we're going to see a new AI winter anytime soon, what we're seeing is already useful and potentially transformative with a few iterative improvements and infrastructure.
For sure we will get a lot stuff automated with it in the near future but this is far away from anything real intelligent.
It just doesn’t really understand and or feel things. It’s dead cause it just outputs data based on it’s model.
Intelligence contains a will and chaos.
It's late spring right now, a strange time to start forecasting winter.
There are too many actually useful things coming out of this for a true winter. And for there not to be a bubble.
ChatGPT as is, is already transformative. It CAN do human level reasoning really well.
The only winter I can see, is the AI gets so good, there is little incentive to improve upon it.
shrug
>It is definitely not reasoning at all
read the paper. GPT4 is the real deal.
Also if these 10 billion dollar models are 'AGI' level, then your model pays for itself if you can find enough interesting work to throw at it.
Humans are unreliable AF and we employ them just fine. Better reliability would certainly be nice but I don’t think it is strictly speaking necessary
My lawyer has been doing pretty much every public filing for civil cases and licenses assisted by GPT. So much bureaucracy could probably be removed by just having GPT validated permissions and manage the correctness of the submissions leaving a human to rubber stamp the final result if at all.
lol. 5%? - that's really laying it on the line
I don't think compute is the issue. It's an issue with LLMs. Current LLMs are just a stepping stone for true AGI. I think there's enough momentum right now that we can avoid a winter and find something better through sheer innovation.
Now the vast majority of the worlds population has a cellphone and internet service, and use services that AI can improve/affect.