Fig. I — Filtered by tag

Tag:attention

2 meditations tagged attention. Back toall tags or the full archive.

Clippings

Foundations · Part 2

One clever trick called "attention" is the real reason AI suddenly got good. Here's the whole idea, no math required.

ML Foundations · Part 2

In 2017, a paper with the almost arrogant title "Attention Is All You Need" replaced decades of accumulated architecture research with one mechanism.