Fig. I — Filtered by tag

Tag:mixture of experts

2 meditations tagged mixture of experts. Back toall tags or the full archive.

Clippings

Shrinking a 2.8-Trillion -Parameter Model

Kimi K3 shipped as the largest open-weight model anyone has released. This piece looks at what the compression crowd has actually managed to do about that, two days in.

Read entry

Vol. IV · 5

Engineering9 min

What Kimi K3 Actually Changed

Deep Dives

Moonshot AI just shipped the biggest open-weight model anyone's ever released, and it's not just big for the sake of being big — there's real engineering under the hood.

Read entry