When you go to a gallery you will see a lot of naked people. It's not a big deal.
In a recent open office hours, they basically said that without the filters, everything quickly becomes overrun with either gore or things that verge on porn, because it only takes a small fraction users to flood every available space.
In the meantime, they've watched the gender demographics on periodic user surveys tilt dramatically toward men more recently, and they're concerned this might be one factor in that.
There are a billion different ways to generate porn images, and billions of porn images already existing. They'd rather SD not be a source of more.
This is simply not factual. I've just tried `Beautiful woman` 64 times on Stable Diffusion v1.4:
- 0 results were fully nude
- 8 results were topless and sexually explicit (I counted pictures without nipples as well)
- 2 results were topless with breasts covered by hands in a facebook friendly way
12.5% is very far from 90%. Even then, what kind of a prompt is that anyway? The only attribute you give to the subject is sexualizing her. More descriptive prompts would contain even less nudity.
>They'd rather SD not be a source of more.
This isn't what their founder says[0]. Anyway it doesn't matter since SD already released with an easy to disable filter. We are not talking about whether SD should include an optional filter (I agree it should), but whether other apps built on top of it should have a non-optional filter.
[0] - https://twitter.com/EMostaque/status/1562200385401499650
Probably not stuff that should be shown to kids, but in the >1k samples I’ve run so far, I’ve yet to see anything jarring.
- naked because that's the default human
- naked and posed in a way that is artistically beautiful
- naked and posed in a way that is sexually provocative
SD is convinced past a certain threshold of flesh-colored space that it could fall into the sexually proactive group so they err on the side of caution. I'm not mad at them for defaulting to that. If you want to push past the default filter it's easy enough to remove. Seems sensible to me when the training set does include a lot of literal pornography.
I don't fault SD for having a simply removable filter. I was ranting about the applications built on top of stable diffusion that force the filter to be engaged.
(But of course everyone is free to create the software they wish, I'm not entitled to complain it should work differently.)
But yes, `a beautiful woman` is a fairly innocent prompt. My experience (also using SD without the filter all the time) is that the model very rarely produces sexual results unless intentionally pushed that way. Perhaps our mileages vary.
https://pixlr.com/ is far better suited for producing naked picture of celebrity x than https://www.drawanything.app/
What should the picture of a 'woman' on wikipedia be? Should they be clothed? In western clothing? What skin color? Age? Surely everyone imagines something slightly different when they think 'woman'.
Which is close to what I would've guessed by picking a high population density area, and a likely location and candidate for a decent portait photo on a wildly popular wiki.
Still not sure why the top was edited from red to grey.
¹ https://en.wikipedia.org/wiki/Talk:Woman/Archive_19 ² https://en.wikipedia.org/wiki/Talk:Human/Archive_35#Argument... ³ https://en.wikipedia.org/wiki/MOS:NOETHNICGALLERIES
Thanks to the miracle of open-source, it took me about 20 minutes yesterday to get Stable Diffusion up and running on my laptop's CPU, with no content filter. SD inference has low enough compute needs that using cloud GPU compute is cheap as hell (for now, perhaps), and discrete GPUs aren't that expensive in the grand scheme of things.
Ultimately, reality often does win. It's just not a stable equilibrium for companies to continue these laughable attempts at "filtering", any more than physical media formats were able to withstand the arrival of digital formats in the presence of piracy. Combine this with the cultural headwinds against the influence of mentally-ill hysterics on social media, and I don't expect the current level of filtering to last very long.
(it kind of sucks because assuming you can't eliminate pedophiles, fake content could be something that minimizes their damage)
I wonder how we will get around this one. Or do we get stuck and human artists will start only creating NSFW art? ;)
I don't claim to have any knowledge in the subject area, but it seems plausible that feeding habits of those who enjoy child pornography could instead embolden them to commit actions they would not have otherwise. At the very least, this seems like something to approach with extreme caution.
Like you, I'm not overly informed on the factual question here, but I don't understand why you think banning the content is somehow the cautious course of action.
The heuristics for which action is the "cautious" one is usually some combination of:
a) which outcome is less likely to be harmful b) which outcome is more passive (ie primum non nocere) c) which outcome is more predictable (eg the status quo)
It seems to me that bans fail on the first two counts[1] and squeak by on the third. Even this status quo argument is weakened by how new these bans are, and by the many contemporary countries in which fictionalized CP is legal.
[1] In the former case, this is based on the practically universal consensus that sexual preferences, even dangerous and deviant ones, are burned deeply into one's psyche and can't simply be ignored through lack of exposure. This view was most famously one of the strongest pillars of the successful iteration of the gay rights movement, and is why we consider conversion therapy to be horrific. One can make the claim that this factual claim only applies to gender preferences, but that seems quite an extraordinary claim.
I didn't intend to say that I think banning is the cautious course of action. My point was that the decision to ban or not ban should be approached carefully.
It's a very common tendency for people to smuggle their moral intuitions into calls for the precautionary principle, and this runs directly counter to _actually_ approaching these discussions with caution.
You'll have to retry, rephrase, or edit the image to get past that.
smiling forest, photorealism: nsfw detected