Tag

#training-data

#agents
#aggregation
#ai
#ai-agents
#ai-tooling
#architecture
#artifacts
#attention
#automation
#banking
#batch
#bean-validation
#bert
#binding
#blackboard
#branching
#broadcasting
#cgroups
#ci-cd
#classpath
#claude
#claude-code
#cli
#configuration
#cosine-similarity
#csp
#data-modeling
#dataviz
#ddd
#deep-learning
#deepseek
#design-system
#developer-experience
#developer-tooling
#developer-tools
#devex
#devops
#dns
#docker
#email
#embabel
#embeddings
#events
#fairness
#fastmail
#fine-tuning
#flyway
#from-java-to-python
#frontend
#fundamentals
#gdpr
#git
#github-actions
#goap
#gpt
#grafana
#guardrails
#hibernate-validator
#hooks
#http
#human-in-the-loop
#ideas
#java
#java-to-python
#jinja2
#junit
#jvm
#kafka
#keycloak
#knowledge-base
#learning
#linux
#llm
#llms
#llms-txt
#loki
#loops
#lora
#machine-learning
#maths-for-llms
#mcp
#mockito
#mongodb
#multi-agent
#networking
#nlp
#oauth
#oauth2
#observability
#okf
#opentelemetry
#otel
#outbox
#parking
#patterns
#positional-encoding
#postgres
#print-css
#privacy
#prompt-injection
#python
#pytorch
#react
#refactoring
#rocm
#search-console
#secrets
#security
#self-attention
#seo
#shipping
#skills
#spring
#spring-ai
#spring-batch
#spring-boot
#spring-data
#spring-data-jdbc
#sse
#ssh
#state
#systemd
#templating
#tempo
#tensors
#testing
#tokenization
#tools
#traceql
#tracing
#traefik
#training-data
#transactions
#transformers
#tts
#typescript
#unsloth
#uv
#vectors
#vite
#waitfor
#web-speech-api
#workflow
#worktree

The Sliding Window: How One Story Becomes Thousands of Training Examples

I printed my first training batch, saw shape [8, 4], and could not say what the two numbers counted. Untangling it - one short story sliced into 1,286 windows, grabbed 8 at a time - made the whole GPT input pipeline finally go transparent.

16 Aug 2026 · 6 min read

#training-data
#llms
#pytorch
#tokenization