Users, not tools, should be judged.
It is unlikely anyone is going to perform act of terrorism with this, or any kind of deep fakes that buy Easter European elections. The worst outcome is likely teens having a laugh.
It is unlikely anyone is going to perform act of terrorism with this, or any kind of deep fakes that buy Easter European elections. The worst outcome is likely teens having a laugh.
Would you want Microsoft to claim they're responsible for the "safety" of what you write with Word? For the legality of the numbers you're punching into an Excel spreadsheet? Would you want Verizon keeping tabs on every word you say, to make sure it's in line with their corporate ethos?
This idea that AI is somehow special, that they absolutely must monitor and censor and curtail usage, that they claim total responsibility for the behavior of their users - Anthropic and OpenAI don't seem to realize that they're the bad guys.
If you build tools of totalitarian dystopian tyranny, dystopian tyrants will take those tools from you and use them. Or worse yet, force your compliance and you'll become nothing more than the big stick used to keep people cowed.
We have laws and norms and culture about what's ok and what's not ok to write, produce, and publish. We don't need corporate morality police, thanks.
Censorship of tools is ethically wrong. If someone wants to publish things that are horrific or illegal, let that person be responsible for their own actions. There is absolutely no reason for AI companies to be involved.
even if it is a local model, if you trained a model to spew nazi propaganda, youre still publishing nazi propaganda to the people who then go use it to make propaganda. its just very summarized propaganda
Your keyboard is.
Censoring AI generation itself is very much like censoring your keyboard or text editor or IDE.
Edit: Of course, "literally everything is a tool", yada yada. You get what I mean. There is a meaningful difference between that translate our thoughts to a digital medium (keyboards) and tools that share those thoughts that others.
Key point right here.
You let people post what they will, and if the authorities get involved, cooperate with them. HN should not be preemptively monitoring all comments and making corporate moralistic judgments on what you wrote and censoring people who mention Mickey Mouse or post song lyrics or talk about hotwiring a car.
Why shouldn't OpenAI do the same?
Would you want DuPont to check the toxicity of Teflon effluents they're releasing in your neighbourhood? That's insane. It's people's responsibility to make sure that they drink harmless water. New tech is always amazing.
There is no definition of a "safe" model without significant controversy nor is there any standardized test for it. There are other reasons why that is a terrible analogy, but this is probably the most important.
I also, to draw a loose parallel, think that Microsoft should be responsible for the security and correctness of their products, with potentially even criminal liability for egregiously negligent bugs that lead to harm for their users: it isn't ever OK to "move fast and break things" with my personal data or bank account. But like, that isn't what we are talking about constantly with limiting the use cases of these AI products.
I mean, do I think OpenAI should be responsible if their AI causes me to poison myself by confidently giving me bad cooking instructions? Yes. Do I think OpenAI should be responsible if their website leaks my information to third parties? Of course. Depending on the magnitude of the issue, I could even see these as criminal offenses for not only the officers of the company but also the engineers who built it.
But, I do not at all believe that, if DuPont sells me something known to be toxic, that it is DuPont's responsibility to go out of their way to technologically prevent me from using it in a way which harms other people: down that road lies dystopian madness. If I buy a baseball bat and choose to go out clubbing for the night, that one's on me. And like, if I become DuPont and make a factory to produce Teflon, and poison the local water with the effluent, the responsibility is with me, not the people who sold me the equipment or the raw materials.
And, likewise, if OpenAI builds an AI which empowers me to knowingly choose to do something bad for the world, that is not their problem: that's mine. They have no responsibility to somehow prevent me from egregiously misusing their product in such a way; and, in fact, I will claim it would be immoral of them to try to do so, as the result requires (conveniently for their bottom line) a centralized dystopian surveillance state.
Because, at the end of the day, counterfeiting money is already illegal.
...and we should not censor tools, and judge people, not the tools they use.
Even more interestingly, and maybe that could help understand that even in the most principled argument there should be a limit: molecular 3d printers able to reproduce proteins (yes, this is a thing) are regulated to recognise a design from a database of dangerous pathogens and refuse to print.
https://www.reddit.com/r/GIMP/comments/3c7i55/does_gimp_have...
Some tools are a lot more powerful than others and we have to take special care with them.
?? You 100% can in the USA it just costs a lot of money.
You cannot own tanks or jets capable of using military ordnance in the US (and I’d wager nearly any country that has anything resembling rule of law). You can own decommissioned ones that are rendered militarily useless.
This is strictly limited to the US. In most advanced democracies you need a stack of papers to get even a small handgun.
Then let's parents choose when teenagers can start driving.
Also let's legalize ALL drugs.
Weapons should all be available to public.
Etc. Etc.
----
It's very naive to think that we shouldn't regulate "tools"; or that we shouldn't regulate software.
I do agree that on many cases the bad actors who misuse tools should be the ones punished, but we should always check the risk of putting something out there that can be used for evil.
C4 and nuke are both just explosives, and there are laws in place that prohibit exploding them in the middle of the city. But the laws that regulate storage and access to the nukes and to C4 are different, and there is a very strong reason for that.
Censorship is bad, everyone agrees on that. But regulating access to technology that has already proven that it can trick people into sending millions to fraudsters is a must, IMO. And it'd better be regulated before in overthrows some governments, not after.
Microsoft Word and Excel aren't generative tools. If Excel added a new headline feature to scan your financial sheets and auto-adjust the numbers to match what's expected when audited, you bet there would be backlash.
And regarding scrutiny, morphine is a immensely usefulness tool and it's use surely extremely monitored.
On the general point, our society values intent. Tools can just be tools when their primary purpose is in line with our values and they only behave according to the user's intent. AI will have to prove a lot to match both criteria.
I went to high school in a fairly affluent area and I promise you this is not true. If you have money and know how to talk to your doctor, you can get whatever you want. No questions asked.
You can even get prescription methamphetamine - and Walgreens will stock generic for it!
If you're really rich it may be a different story, but any of the "middle class" good luck. And if you do find a doctor with some compassion, they are probably about to retire.
That's a decently high bar I think ?
Imagine what you can do if you have money and know how to talk to your local police...
- Sounds like what my accountant already does.
This does not need to become a thread about bullying and self harm, but it should be recognized that this example is not benign or victimless.
This genie is out of the bottle, let us hope that laws about users are enough when the tools evolve faster than legislative response.
[edit:spelling]
And the teens are having a laugh by... creating deepfake nudes of their classmates? The tools are bad, and the toolmakers should feel deep guilt and shame for what they released on the world. Do you not know the story of Nobel and dynamite? Technology must be paired with morality.
I think the degree of power matters.
You can argue that that’s how it should be, but that isn’t how it is. And we don’t know what a world that adhered to that principle would look like, it’s possible it would be a disaster. There are a lot of bad things people can do where it’s difficult to catch someone after they’ve done it, and prevention at the tool level is the only way to really effectively stop people.
I’m not saying I like the idea of any of these methods when it comes to AI, but it feels naive to act like there isn’t precedent for stuff like this.
> It is unlikely anyone is going to perform act of terrorism with this, or any kind of deep fakes that buy Easter European elections. The worst outcome is likely teens having a laugh.
Citation needed bigtime. Sure, people doing organized disinformation campaigns won’t log into OpenAI’s website and use Sora, they’ll probably be running Hunyuan Video with an on-prem or cloud-based GPU cluster, but this feels like as good a time as any to discuss the implications of video generation tools as they stand in December 2024.
Especially certain someone that’s worth a billion dollars, is 100 years old and their name ends with inc.
Finally people do not label Slovakia as Eastern Europe...