Honestly, I'm surprised it lasted this long. Like that was clearly egregious. At least pretend to not be a deep fake porn generator...
Why? Like, people are going to do it anyway. Whether in their minds or with some tool. Public or behind closed doors. That genie is very firmly out of the bottle, and it’s not going to go back in. At least when it’s on Civit it’s abundantly clear it is fake content.
You can run any of these models on a consumer GPU.
If you want to argue no one should expect to have anything to hide, you'd better do it from a glass house and in the altogether if you mean to be taken seriously, don't you think? It is a radical departure. The example is therefore necessarily yours to set, else you show yourself a hypocrite.
It’s fundamentally no different from acknowledging that there may be a fanclub on the other side of the country with a stash of aeolun porn. As long as they’re not using it to advertise their services, and don’t tell me what kind of degenerate things they’re doing with it, what does that hurt me?
Now that you’ve said it I’m actually mildly curious what would happen if I fine-tune a model purely on myself. But what would I do with it even if I made it? I can’t post it on Civit any more can I?
But we make laws for the citizenry, not for you and me in particular. What news since diffusion models reached consumers suggests the citizenry can be trusted with tools this powerful? You can't buy a howitzer at Home Depot, either. These things are dangerous. I believe I recall hearing that people have died. Making the tools require some effort and skill to find seems warranted.
Or did you think they cease to exist for no longer being so openly hosted? I'm sure such things are already traded in secret, and any traffic analyst with a sufficiently privileged perspective no doubt today knows much more about where and by whom.
Just because something is possible doesn't mean it has to be allowed to happen
Meanwhile I used a couple LoRAs to make JD Vance memes when that was the craze a few weeks ago, and now those are getting nuked... No fun allowed, thanks payment processors.
And did they apply the detector uniformly? Like you get the detector on Emma Watson, but does it apply to Hermine Granger? Because I definitely saw that situation reoccurring. Seemed to be extremely common with cartoon characters. Especially given the explicit nature of PonyDiffusion, mixing anime generation and realsm... Just turn of NSFW filters and go look at top models and top LoRAs. Nude content dominates the charts.
Let's also be clear, there is a gender bias. I'd wager quite a lot of money that there are far fewer JD Vance nude deep fakes than many female celebrities.
Characters are a bit tricky. For example, Lara Croft could refer to the fictional video game character, or the character in the movie played by Angelina Jolie. They allowed the former, but not the latter. Or a model trained on the concept of "Hermione Granger" from fan art would be allowed, but not a LoRA trained on Emma Watson from the movies. That seemed like a pretty reasonable position to take.
I don't mean just trained on. I mean there's a ScarJo lookalike front and center.
If you're expecting the LoRA attached, I guess you can go with one of those "AI Characters" and that's at least feigning compliance. But come on, you can hide the LoRAs that were used too. But come on... the models themselves ingest a lot of porn photos and celebrity photos. You really think this is going to stop someone from just describing the celebrity and getting their nude? Don't be so dense. You aren't fooling anyone here
What exactly are you proposing here that CivitAI didn't do already? Yes, people can scrub metadata from images. This is the exact same issue that image hosts have faced for decades - people can upload abusive or illegal images. The solution has been to do automated filtering, and have users report content that slips through. The solution is not to ban Photoshop because some people use it to make fake nudes.