#transformers

LLMs, the whole thing · Part 6

The first attention mechanism in Raschka's LLM book, explained the way it finally clicked for me, a Java dev who bounces off dense maths: self-attention is just three operations, a dot product, a softmax, and a weighted average.

• #transformers
• #deep-learning
• #attention
• #self-attention
• #llm

LLMs, the whole thing · Part 2

Every modern LLM is a transformer, yet BERT, GPT and T5 behave very differently. The first article in a ground-up series on LLMs: the single distinction — the attention mask — that separates an encoder from a decoder.

• #transformers
• #deep-learning
• #gpt
• #bert
• #llm