> Its already been shown synthetic training data is just as good if not better.
Source, please! I'm a machine learning layperson but how can this not be overfitting?
Source, please! I'm a machine learning layperson but how can this not be overfitting?
> AIDE demonstrates that recursive self-improvement at the harness layer can produce transferable gains in an AI research agent’s research efficiency. During the recursive self-improvement run, the loop accepted seven rewrites, each under a fixed evaluation budget (section 3.2). Under this fixed evaluation budget, gains in optimization capability on AI R&D tasks translate to gains in research efficiency."
https://arxiv.org/abs/2609.11873
> The Last AI Built by Humans: Toward Genuine Recursive Self-Improvement
AI-generated data might not always be that useful, but at least in this case it obviously is.