Tag:synthetic data

I Built an 11,200-Example Synthetic Dataset, Fine-Tuned a Model, and Then Didn't Ship It

A post-mortem on the Dragon Commentary Studio LoRA: what the data pipeline got right, why the fine-tune still lost to the base model, and why shipping the base model was the correct engineering call.

Synthetic Data: Training Models on Text That Models Wrote

Data Engineering · Part 3

There's an idea that would have sounded like a joke a few years ago: take a language model, have it write its own training data, and train the next model on it.