#gpt

LLMs, the whole thing · Part 3

An LLM never sees your text — it sees integers. Building a tokenizer from a regex and a dictionary, hitting the out-of-vocabulary wall, and why GPT’s byte-pair encoding is the fix that needs no unknown token.

• #fundamentals
• #nlp
• #gpt
• #llm
• #tokenization

LLMs, the whole thing · Part 2

Every modern LLM is a transformer, yet BERT, GPT and T5 behave very differently. The first article in a ground-up series on LLMs: the single distinction — the attention mask — that separates an encoder from a decoder.

• #transformers
• #deep-learning
• #gpt
• #bert
• #llm