Large Language Models Suffer from Their Own Output

Evidence that language models trained on their own output can lose quality and diversity, even while the prose remains superficially fluent.

Briesch, M., Sobania, D., and Rothlauf, F. 'Large Language Models Suffer from Their Own Output.' arXiv:2311.16822, 2023.