# Phase 10: LLMs from Scratch

> Build, train, and understand large language models.

## Start this phase on GitHub

**Prerequisites:** Phase 5 NLP Foundations. Phase 7 Transformers is strongly
recommended before the model-building lessons.

**First lesson:** [Tokenizers](01-tokenizers/)

Run this command from the repository root:

```bash
python3 phases/10-llms-from-scratch/01-tokenizers/code/main.py
```

Keep the command, exit code, encode/decode round-trip results, learned merge
count, and compression ratios. `tiktoken` is an optional comparison.

**Next action:** Add a word the tiny corpus has not seen, inspect its pieces,
then continue to [Building a Tokenizer from Scratch](02-building-a-tokenizer/).

Browse the [full Phase 10 lesson list](../../README.md#phase-10) or the
[cross-phase roadmap](../../ROADMAP.md).