LLMs from Scratch

Build a Large Language Model (From Scratch)

Appendix A: Introduction to PyTorch

LLMs from Scratch

Appendix A: Introduction to PyTorch

Appendix C: Exercise Solutions

Appendix D: Adding Bells and Whistles to the Training Loop

Appendix E: Parameter-efficient Finetuning with LoRA

Recommendations for Getting the Most Out of a Technical Book

Chapter 2: Working with Text Data

Byte Pair Encoding (BPE) Tokenizer From Scratch

SimpleTokenizerV3

Chapter 2: Working with Text Data

Chapter 3: Coding Attention Mechanisms

More Efficient Multi-Head Attention Implementations

Understanding PyTorch Buffers

Chapter 3: Coding Attention Mechanisms

Chapter 4: Implementing a GPT Model from Scratch To Generate Text

Bonus Material: KV Cache

出处与许可

来源信息

本页目录

LLMs from Scratch源码研读·英文原文 ↗仓库 ↗

Please see the README.md in the setup directory for Python installation and setup recommendations.

Pager

AI 原生开放教材·GitHub 仓库·@faruheaisha·署名与许可编排与站点代码 MIT · 课程内容著作权归各上游作者