Roadmap
GuideChallenges0/2

Foundations

Introduction
From Text to Bytes
Tokenization
The Vector Space
Positional Encoding

The Transformer Core

Attention
Multi-Head Attention
Feed-Forward Networks
Residuals & Normalization
The Transformer Block

Project GPT

Project: Building GPT
0/ 2

2 problems