Roadmap
GuideChallenges0/1

Foundations

Introduction
From Text to Bytes
Tokenization
The Vector Space
Positional Encoding

The Transformer Core

Attention
Multi-Head Attention
Feed-Forward Networks
Residuals & Normalization
The Transformer Block

Project GPT

Project: Building GPT
0/ 1

1 problem