Definition
The idea that AI models trained on data generated by other models may gradually degrade in quality, novelty, or accuracy. A GPT-6 model trained mostly on synthetic content from GPT-4 may lose grounding in real human expression.
AI model degradation from synthetic training data
The idea that AI models trained on data generated by other models may gradually degrade in quality, novelty, or accuracy. A GPT-6 model trained mostly on synthetic content from GPT-4 may lose grounding in real human expression.