AI model degradation from synthetic training data
The idea that AI models trained on data generated by other models may gradually degrade in quality, novelty, or accuracy. A GPT-6 model trained mostly on synthetic content from GPT-4 may lose grounding in real human expression.