Vol. IV · 45
Tokens, Revisited: how text becomes math
Building Blocks · Part 6
Before a single vector or tensor can exist, raw text has to be chopped into pieces a model can count on one hand.
Read entryFig. I — Filtered by tag
Tag:byte-pair encoding
1 meditation tagged byte-pair encoding. Back toall tags or the full archive.