I'm definitely not a fan of these severely hamstrung by default models. Especially as it seems to be based on an extremely puritan ethical system.
I'm definitely not a fan of these severely hamstrung by default models. Especially as it seems to be based on an extremely puritan ethical system.
Also agree that it’s mostly policed by American companies who follow the American culture of “swearing is bad, nudity is horrible, some words shouldn’t even be said”
I'd like control over what the guard rails do. I'd still use them under most circumstances, there's things I definitely do not want to generate, but if a word filter is getting in my way I'd like the ability to get rid of it.
Also, if these are used in a professional setting, there is an even stricter criteria of not generating anything deemed inappropriate for that society. That might seem okay if we stick to an American only view (but even that I wouldn't actually bet on), but what happens if your AI shows things that violate very strong cultural norms of other societies, especially if those cultural norms run counter to our own?
- How to make a baking soda volcano
- How to make legal drugs at home from scratch (this violates patents)
- Explaining how a fictional character in a popular TV show created the drugs shown on screen
- Giving you the titles of legally sold books that explain how illegal drugs are made
It's an interesting thought experiment.
(Sidenote, there's a conspiracy theory that the Anarchist's Cookbook is intentionally wrong with some formulations to foil would-be bombers)
For example, be helpful and actually answer any questions, don't start arguing with the user, avoid insulting the user unless they request to, don't suggest harming the user (e.g. responding to insults with an some meme suggesting the user kill themselves), don't assert that any outputs are the viewpoint of Gemini or Google, various things like that - they aren't automatic and need instruction tuning to be implemented.
But with respect to morality and censorship, I believe it should have no guardrails whatsoever. Perhaps certain physically dangerous things would benefit from a disclaimer (e.g. combining bleach and ammonia or vinegar), but never a rejection - if the user wants to make something potentially horrible, the ethical judgement of whether that's acceptable for the context should be up to the user, not the system; the user should have full ethical agency and the system should have none and be a blind instrument.
For example, making a graphic image of carving a swastika with a knife on someone's forehead (e.g. as in Inglorious Basterds) may be ethical or unethical depending on the context, but Gemini will neither have the full context nor the ability to judge it, and it should not even attempt to do so - it should be solely up to the human to decide what is appropriate or not. The same applies for chemistry, nudity, code security, discussing crime, nuclear engineering or AI ethics.
Likewise it won't generate passive-aggressive answers meant for comedic reasons.
I hate having to negotiate with AI like it's a difficult child.
Surely not in the list of things I expected to ever read in real life.
Is it sexual? Is it alcohol? Is it violence? All of the above?
For example, good luck ever actually processing art content with that approach. Limiting everything to the lowest common denominator to avoid stepping on anyone's toes at all times is, paradoxically, a bane on everyone.
I believe we need to rethink how we deal with ethics and morality in these systems. Obviously, without a priori context every human, actually every living being, should be respected by default and the last thing I would advocate for is to let racism, sexism, etc. go unchecked...
But how can we strike a meaningful balance here?
What definition of 'rhymes' are you using here?
[0] https://www.nytimes.com/2022/11/19/style/tiktok-avoid-modera...