It is a machine that optimizes profit and absolutely nothing else. It does not and cannot consider what is "good" or "right" or even "legal" unless and until one of those things directly and indisputably hurts profits too much.
This is magical thinking. "The market" is fundamentally incapable of making things better for you, the consumer.
For example, I think that OpenAI's system of incentivizing automated credit purchases borders on being predatory. Not because it would be hidden info. Just because the product is clearly aimed at consumers who do things that they might not fully understand.
For me, I don't habe any issues with their current design.
But for John Doe vibe-coding their nutrition analysis app, I feel it's wrong to advertise automatic payments and long-running tasks without providing a clear fee cap option.
It's similar to gambling.
If you have oligopoly without the regulations who do you think benefits more from that?