Good Omens StudioStart a project

Home WP plugins Case Studies Our Projects Meditations Series About Contact Start a project

Fig. I — Filtered by tag

Tag:scaling laws

3 meditations tagged scaling laws. Back toall tags or the full archive.

Clippings

Are we close to AGI, or is it all hype?

Foundations · Part 9

The question that started this whole series, revisited now that you actually know how the current stuff works.

Data Engineering

Quality vs. Quantity: The Data Question That Keeps Changing Its Answer

Data Engineering · Part 2

Every training run begins with a budget question: you have finite compute and finite data — what maximizes capability?

Machine Learning

Scaling Laws: The Physics of Machine Learning

ML Foundations · Part 3

Most of machine learning research is messy and empirical — try something, see if the benchmark goes up. Then, in 2020, a team at OpenAI published a result with a completely different character.