I'm interested how much "Clean Data" is synthetic data from "unclean" models...
> without distillation from third-party models
sounds like zero unless they are lying.
Though this is largely impossible these days, unless they pre-trained on pre-AI era data.
Adding "unless" to a statement makes it vacuous if the latter clause is weaker than the first clause. I find it hard to believe that a company willing to violate licenses would have scruples about lying about it.
I think that's the point. "How do I say they're lying without outright saying they're lying?"
It's a common rhetorical trick.
Also, “Microsoft is lying” is not a logically stronger statement, because they might be lying about something other than whether they distilled or trained on AI output.