Transformers: the meeting where everyone listens to everyoneThe 2017 idea behind ChatGPT, Claude and Gemini, told as a family meeting where every word decides who to pay attention to.NLP
3 posts
Transformers: the meeting where everyone listens to everyoneThe 2017 idea behind ChatGPT, Claude and Gemini, told as a family meeting where every word decides who to pay attention to.
Tokenization: why AI reads in piecesAI models do not read letters or words. They read tokens, and that small detail explains pricing, limits and why Urdu costs more.
Embeddings: a map where words liveHow AI turns words into coordinates, so that 'biryani' lives near 'pulao' and far away from 'tractor'.