Build a Large Language Model (From Scratch)
#5 in KI-Lehr- & Produktivitäts-AppsUnknown · large · 2× · tolest 25. Sept. 2026
50
Momentum
"Build a Large Language Model (From Scratch)" is a technical non-fiction book by Sebastian Raschka, published by Manning Publications. Using Python and PyTorch code, it teaches step-by-step how to develop, pretrain, and Fine-Tune a GPT-like language model for classification and instruction following. The book is not a software product, but a learning resource that includes an accompanying GitHub code repository, video course, and interactive liveBook version. It serves as the foundation for the follow-up "Build a Reasoning Model (From Scratch)".
Momentum-Verloop
27.06.25.09.
Features
| Output Formats | Paperback, eBook (PDF/ePub/Kindle), audiobook, liveBook (online) |
| Base Model | Self-coded GPT-style model (no existing LLM libraries used) |
| Integrations | Companion code repository on GitHub (Python, PyTorch) |
| Collaboration | Book forum and liveBook with built-in testing system/discussion |
| Platform | Book (paperback, eBook, audiobook, Manning liveBook online) |
| Price | $59.99 (paperback, list price) |
| Release Date | October 29, 2024 |