Independent · Nonprofit · Open access
Deep Lex

AI Glossary

Model Collapse

AI model degradation from synthetic training data

Short definition

The idea that AI models trained on data generated by other models may gradually degrade in quality, novelty, or accuracy.

Definition

Definition

The idea that AI models trained on data generated by other models may gradually degrade in quality, novelty, or accuracy. A GPT-6 model trained mostly on synthetic content from GPT-4 may lose grounding in real human expression.