Hacker News Reader

Comment by jsheard | Hacker News Reader

You could do that, but OpenAI specifically doesn't want you to: https://openai.com/policies/row-terms-of-use/

What you cannot do. You may not use our Services for any illegal, harmful, or abusive activity. For example, you may not: Use Output to develop models that compete with OpenAI.

Presumably you run the risk of getting banned if they realize what you're doing.

View on HN

> You may not use our Services for any illegal, harmful, or abusive activity. For example, you may not: Use Output to develop models that compete with OpenAI.

This reads as if they consider developing models that compete with OpenAI as illegal, harmful or abusive. Which is crazy. (The other dot points in their list in the linked terms seem better).

Screw their TOS.

OpenAI trained on the world's data. Data they didn't license.

Anyone should be able to "rip them off" and copy their capabilities on the cheap.

The irony isn't lost on me, but irony isn't going to stop them kicking you off their platform if they feel like it.

I wonder if some of the high pricing is specifically an attempt to ward off this sort of "slow distillation" of a powerful model

I suspect they have no way to enforce that without risking false positive hurting their rich customers (and their business).

If it was possible:

1) Why wasn't OpenAI doing it themselves?

2) This means we've reached technological singularity if AI models can improve themselves (as in getting a smarter model, not just compressing existing ones like Deepseek)

Compressing existing models is exactly what we are talking about here.

Then why wasn't OpenAI doing that themselves ?

Who says they arent?

It’s not a singularity because the synthetic data generated by the previous frontier model isn’t usually fed directly into the training for the next frontier model - a “discriminator” is applied to select only the highest quality responses. That discriminator could be a field expert or mechanical turk or another model trained to select for higher quality responses (i.e. trained on a dataset of books rather than internet content).

As far as I know, OpenAI has been doing this, using both experts and Kenyan workers as well as their own discriminator models. Unfiltered synthetic data is generally used more for distilled models and fine tunes for a specific use case.

Synthetic data is just as useful for building app layers evals. Probably significantly cheaper ways to get the data if you’re training your own model.

I compete with AI, not my models.

Reply on news.ycombinator.com