A lot of people here aren't going to like it, but the only reasonable way out I can see is to eventually socialise ownership and control of AI.
I don't see an alternative that isn't really bad.
I don't see an alternative that isn't really bad.
As far as I can see as of now, there is no "realistic" way out. It's a problem of human nature... People are corrupt, people with authority are more corrupt, and people with money and authority, even more. Come intelligent and cheaply mass-produceable robots, and we'll have a new, 4th level spinup too that will be worse than the first 3, combined.
I'm sure a country like the US, which is filled with lawyers, can come up with a couple laws, and find some goons to enforce it, that cannot possibly be that hard when other countries can figure it out too.
If companies control the government, then that's not a government, that's a group of companies.
The AI industry is built on mass piracy and copyright violations, regulation isn't going to make it go away or even comply any time soon.
We have laws banning technology that can be used to produce generative images of someone that look like them with their clothes off. The result wasn't fixing generative AI (we don't know how to actually control that kind of thing because it's almost impossible to manually tweak a machine learning model), but to add a bunch of input and output filters that'll pass the test for most regulators checking compliance.
Another possibility is that, once AI exceeds human performance in all economically useful activities, including high-level planning, governance, law enforcement, and military actions, it discovers that the benefits of keeping humans around aren't worth the costs and risks.
Bad: the above but also their power and influence grows so much and governments are so ineffective (or corrupt) against them that the tech companies also become de facto governments and people rely on them to survive. Also they destroy earth even faster with nobody left to stop them. The full fat cyberpunk dystopia.
Bad: the above but with lots more fascism and war. Too many people seem to want this.
Bad: regulate AI to such an extent as to cede all growth and technological leadership to whoever doesn't
...
Small players can't afford cost of regulation.
Then create a layer around that which all small players pay into so they can participate regardless of whether they do or not - something like insurance or licensing.
Modernity.
I think governments should invest in their economies - mostly by investing in research, education, infrastructure, health and wellbeing of citizens, etc. but also putting capital into the later stages of expansion would make sense.
I certainly don't think people should not be able to start or own or profit from companies. But I do see a reason to limit their scale and/or make them more publicly owned beyond an certain scale.
I quite like the idea that "public" markets should become truly public, e.g. by some ratcheting percentage of public companies becoming owned by society at large over time (there would be several ways this could be done). This somewhat happens with the largest companies via index funds but only for those big enough to be in the indices and the distribution in unequal.
Maybe there are other/better ways, but it's pretty clear to me that big companies have a lot of negative impacts that aren't properly accounted for and so they are a very significant way in which a few people get richer at the expense of everyone else.
I find the technical discussion more interesting and could do without some of the moral grandstanding in the comments.