Tag:model collapse

Synthetic Data: Training Models on Text That Models Wrote

Data Engineering · Part 3

There's an idea that would have sounded like a joke a few years ago: take a language model, have it write its own training data, and train the next model on it.