I see this comment over and over and over here on HN and it really blows my mind that people don't get it. These models are made so that enterprise clients will pay a lot of money to use them. I was a director at S&P Global and if you brought in software that could make pornographic images, violent images, or introduce copyright violations into our research you would be laughed out of the room within exactly 1 minute. The push for "safety" is that we live in a capitalistic society and the people will pay the most money for access to these models will want them to be "safe". If you don't like it, go ahead and create a competitor and see how many sales you get to enterprise customers.

SV isn't trying to be your nanny. They are trying to make money. I'm shocked this isn't obvious to well-educated people who visit this forum.