Model Collapse
Trained on its own output, a model forgets the rare and the strange and drifts toward its own average.
ExampleEach generation writes more fluently and has less to say.
What to doKeep human-made and original data in the loop, and label what was generated so it isn’t mistaken for the real thing.
Paste this into the chatAnswer from original sources where you can, and tell me which parts of your answer are common patterns rather than something you can point to a source for.