Who doesn't want their work and what they're doing to matter? This is the ultimate mattering.
And with that, you also get your own hero story.
Same dysfunction as always. Our branch of the economy is funda-mentally unwell.
100%
The hubris is immense
There are plenty of offline things that are more dangerous than AI
Is this Blake Lemoine 2.0?
https://thezvi.substack.com/p/the-three-ai-pills
That's fine, but it would be useful to explicitly say that is the disagreement, rather than just claim "hubris". Otherwise conversations are just looping.
Yes you're right there are plenty of offline things more dangerous than just ordinary AI, and arguably than AGI (not so sure). There definitely aren't, pretty well by definition, such things more dangerous than ASI.
I think ASI is possible, and that AGI will have a high chance of leading to it.
I have observed that these initialisms do not have generally agreed upon meanings; they are not useful for discussions with people who have not already stated what precisely they count. There is disagreement about all three (/four) initials, and also how to combine them.
To give a sense of scale of how bad this is: some people on this very site have even denied that LLMs are "AI" at all, despite solving for natural language being a long-standing part of the field since, y'know, Turing.
On the other hand, the original ChatGPT was already (by my use of the words), "an AI", and while it was not superhuman in performance at any single thing, it already had a superhuman breadth of knowledge and a superhuman speed. For the former, even being properly fluent in five languages would be an absurd ask for a single human.
Spiky intelligence. How do the "G" (or "S") and the "I" part interact? Does something only count as "AGI" when for each task that has humans who do it regularly, it's as good as the average?* Does it only count as ASI when it's better than all humans at all tasks? Is it not "superhuman" to simply be as good as the median human while being 1% of the cost?
For some people, the cost matters; for others, the speed; for p(doom), competence.
* i.e. as good at speaking Korean as the average Korean, not merely as good at Korean as the average random human selected worldwide; as good at plumbing as the average plumber, not merely the average random human selected from all professions and unemployed alike.
It’s just silly talk. My dad works for Nintendo and he can give me a gold foil pikachu any time he wants, also, he can delete your Pokémon any time he wants because he has admin access on the Nintendo server. And also he can beat up your dad because he has a black belt. Oh your dad has a black belt? Well actually I lied, he has a rainbow belt which means he can beat up your dad still.
Like this is silly right? It’s insulting. We both know that there are live nuclear weapons whose coordinates point at my city and at your city and the only thing that stops them is two keys and a button. Nuclear weapons, you know those things that have killed hundreds of thousands of living men women and children? There is no room for speculation in that regard: my city has a navy base and there is a live nuclear weapon pointed at it, myself and my entire family will die if it goes off. Now contrast: ahem.
Oh sorry my dad also has like a super secret rainbow STEALTH powers that could actually totally insulate my house from nukes. If you think about it, I actually have no reason to be concerned.
Frankly, we, our culture, this fake America that is parasitized by psychologically narcissistic people that have been doing nothing but wage war and destruction and spread misery and killed millions upon millions while blaming it on everyone else under the sun… those people development AGI is the problem… lying, abusive, psychopathic, narcissistic maniacs developing AGI is the problem that endangers all of humanity and life on this planet; and not likely by ways people actually understand.
The danger is not likely AGI itself, it’s that it was programmed by utterly evil and diabolical types of people who orchestrate and instigate wars that kill tens of millions, and stand at the sidelines and profit from both sides, happy and gleeful that you are killing each other.
Why would AGI trained by that psychopathic clan, the treaty breaking, the murder hiding, the war instigating, the war crime committing clan not also use those methods and practices since they’re already in control of AI and have impressed their nature on it through contemporary “American” culture they have made the most toxic and pestilent culture humanity has ever produced?
And I don’t apologize for “language” that offends delicates sensibilities. Look your children/grandchildren in the face and tell them they can die and suffer and you don’t care, if you don’t like how I’m delivering reality.
I think people generally underestimate how much change a small "dedicated" group of people can achieve if morals are considered optional.
A lot of the debate on AI and its consequences is built on various assumptions that all kinda take the status quo (apathy, regulatory capture, but also laws) and take that as a given.
History - like e.g. the third reich, but also military coups - however tells us that these kinds of assumptions can be void at any time for any reason without a mandate or a democratic resolution to do so.
I am practically certain that before everything collapsed as predicted, someone will "restore order" by any means necessary.
If that means shutting down the Internet, the Internet will shut down. If that means "shutting down" people, then people will be shut down.
The predicted scenarios are all invalid states that the rules governing the underlying system will not allow to exist; or at least not for long.
The whole thing feels unreal to nearly everyone - the only tangible write-up I've seen was in Plan A. I don't think people have thought through the good scenarios tangibly, never mind the bad ones.
I can't really provide a full picture here as I just make stuff up as I go, but the first word that came to my mind when reading your question was "atomization".
Not sure what my brain wants to tell me with that, though.
It might be one of the prerequisites for the current state. It might be what changes for greater change to quickly snap into existence. Or it might also be brainfart.
Not sure if a quick answer like this is helpful, but maybe there will be a longer answer later. Or not. The brain works in mysterious ways.
__
Hmm. It might be that the mechanisms that have been pushing said atomization could perhaps break down due to the reward systems breaking down.
And then suddenly collectives violently snap back together like these neodymium magnets that make that fun sound.
Which, in more concrete terms, could possibly be translated as "people might get so sick of everything, they prefer logging off and talking to their neighbors instead". Although that is a translation that comes with resolution loss.
___
Another thread to pull on here is that AI hyperinflates all sorts of things like fake merit or similar.
So stuff like virtual internetpoints driving people might not continue working.
Or if AI steals all our jobs as proposed, then maybe people will not take the monetary system in which AI wins seriously anymore.
Hope your brain works on this and writes something - we have lots of very odd future possibilities, and we're not really ready or planning for them, so making them tangible helps.
It's not a real scenario. It's just rationalizing the "oh shit, they're coming for my head if I don't stop optimizing for my own benefit". "What can I do what can I do.. I know.. Army of Robots. I am safe and have nothing to change about anything I do".
You can tell that it is just that by considering the logistics of the proposed scenario.
__
Every time we see vengeful AI or robots, we merely see a reflection of the currently winning meatbags, their character, their flaws, their fears and their goals.
___
On the logistics note:
You can I think also see the hubris of the IT people in that, because "supply chain" for them means "npm", and that can be replaced with an LLM.
It breaks minds to be able to create value out of nothing just with your brain. It makes you believe that the whole world would work like that.
It however does not. And you cannot just compensate that with blitzscaling robots. The supply chain of.. literally any object you can find around you is absurdly complex. Even the most simplest stuff.
And it's also not documented, but even documentation wouldn't help you there. Experience in requirements engineering should make the "why" there obvious.
Ah the good old appeal to / waiting for higher authority that will be moral and just and will do whats right and correct things.
Thats the shit naive humans hope for, thats why fairy tales of religions can still be acceptable in 21st century for some, despite often sounding like from (bad) disney cartoon movie.
I bring you alternate, more realistic view - there is nobody like that. We are in this on our own, its on each of us. Either we act or let things go as they will. So, not really good outlook, is it. Maybe this is the Great filter event.
Its one of those technologies that brings a lot, but for every single thing it brings it feels like we as mankind are losing much more than gained.
> Thats the shit naive humans hope for,
No, you've misread me. I'm not "hoping" for anything. I've just wrote down what I suspect future outcomes will be in the same way a meteorologist predicts a storm or similar.
Whether you're interested in the weather forecast is a different question.
I really think this sort of claim needs to stop. Capitalism, like "patriarchy" is not a force in its own right. Capitalism is a system that encourages value creation for one's customers. That's not perfect, but it's still best so far.
And second: What if other systems are less corruptible and exploitable? How do you know whether all systems have the same potential for corruption and exploitation?
Capitalism is a system that explicitly rewards greed, and that gives the most power to the people with the most to gain from exploiting said power. Why is it unreasonable to believe that other systems are likely better on these fronts?
As for the second, the more in control of the system humans are, the more they can exploit it. Your return on exploitation, which I think is really what you're getting at, is based on how diffuse the control and power is at the point that you exploit it. But the more diffuse control and power, the less responsive and effective the system is when working at full tilt. It's two sides of the same coin.
Capitalism is a system of decentralized resource allocation. Decentralized systems have their pros and cons, and other systems that would rely on centrally planned economies have pros and cons. Capitalism isn't the issue, unfettered capitalism is the issue.
Funnily enough, in my eyes it's obvious that capitalism in a globalized world must inevitably lead to unfettered capitalism, since the gravity effect of money along with competition between countries for their investments (with tax breaks etc. ) inevitably allows the capitalists to change the laws in their favor more and more. So I would ask for an objective measure of "how much in control humans are". I don't think it's a single dimension like you're implying, and I don't think capitalism is near any optimum due to the aforementioned effect.
Which non-capitalist system does not ultimately concentrate wealth and power even further? And, if nation-states are organisms, and survival of the fittest is a law, which of those systems can survive in the real world? Excepting perhaps those propped up by a disproportionate natural wealth and homogeneous culture, where it is easier for people to continue to believe in "our good" when hard times come.
Capitalism is the only system that pretends to respect human nature - gives us a lever that says, "want more stuff? provide more value." It gives the self-interested a healthy outlet that the other systems lack. It must be managed, though, by power, and when the two collude you get fascism. So, I guess maybe I share your view, that lobbying breaks the system.
IMO it's not possible to justify your claims without taking a whole tower of (IMO likely false) assumptions for granted. I'd love to go into detail on each assumption I see, but I've had similar comments regarding flaws of capitalist systems get derailed too many times by very angry commenters who insist that such thoughts are not worth discussing and MUST NOT be discussed.
The naive view is to think that lobbying is automatically bad. Policymakers can choose who they talk to. If you're worried about corrupt policymakers, you've correctly identified where power resides: in government.
All I did was disprove your theory that private companies have no power, and that you or I have the same options to influence the government.
I don't see why you're talking like this. It's "not even wrong" in the sense that it's entirely correct. Monarchy and socialism grab money through taxes, and if you think monopolies are bad, wait til you're forced to use the state service that has no motivation to do well because there's no competition. It's not only a monopoly, it's a monopoly that takes your money by force.
Capitalism requires investment and risk and competition to drive value up for customers who can choose. So you need to produce value for your customers to survive, and produce a profit after costs and taxes.