Roadmap
GuideChallenges0/3

Foundations

Introduction
From Text to Bytes
Tokenization
The Vector Space
Positional Encoding

The Transformer Core

Attention
Multi-Head Attention
Feed-Forward Networks
Residuals & Normalization
The Transformer Block

Project GPT

Project: Building GPT
0/ 3

3 problems