#bert

LLMs, the whole thing · Part 2

Every modern LLM is a transformer, yet BERT, GPT and T5 behave very differently. The first article in a ground-up series on LLMs: the single distinction — the attention mask — that separates an encoder from a decoder.

• #transformers
• #deep-learning
• #gpt
• #bert
• #llm