This is wholly unrealistic. Any product can be used to cause harm and there are always steps that could be taken to prevent that. E.g. ceasing sales. But that would often do more harm than it prevents.
You can’t go after a company that makes kitchen knives if those are used to harm bc there’s nothing reasonable they could have done to prevent that harm, and there’s a legitimate use case for knives for cooking.
In this case, my understanding is other companies (OpenAI and Anthropic) have done more to limit harm, whereas XAI hasn’t.
But in this case it’s pretty easy, other model providers have in fact limited harm better than grok. So you don’t even need something arbitrary, just do it as well as competitors.
OK. A different and better question.
The problem is, would it be considered reasonable to avoid harm to the mental wellbeing of bikinified persons at the cost of harm to all users enjoying a service supported by bikinification earnings.