Vol. IV · 45
Tokens, Revisited: how text becomes math
Building Blocks · Part 6
Before a single vector or tensor can exist, raw text has to be chopped into pieces a model can count on one hand.
Read entryFig. I — Filtered by tag
Tag:tokenization
1 meditation tagged tokenization. Back toall tags or the full archive.