#tensors

From Java to Python

Before I could make sense of attention code, I needed PyTorch's tiny tensor vocabulary to stop feeling mysterious. This first session covers shapes, axes, batching, and the important difference between stack, cat, multiplication, and dot products.

• #java-to-python
• #python
• #pytorch
• #tensors

Maths for LLMs

The positional-embedding sum quietly relies on broadcasting. Here is the whole rule — align from the right, stretch the 1s — and why PyTorch never copies a byte.

• #broadcasting
• #embeddings
• #maths-for-llms
• #pytorch
• #tensors