Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data
An important qualification to the collapse story: synthetic data need not be fatal when genuine data continues to accumulate alongside it. The recipe matters.
Cited in
Gerstgrasser, M., et al. 'Is Model Collapse Inevitable? Breaking the Curse of Recursion by Accumulating Real and Synthetic Data.' arXiv:2404.01413, 2024.