Build a Large Language Model (From Scratch)

What You Will Learn:

• Plan and program all parts of LLM
• Prepare datasets for model training
• Fine-tune LLM for text classification and custom data
• Use feedback to improve instruction execution
• Load pre-trained weights

The book will guide you through the internal mechanisms of generative AI, allowing you to not only understand how LLMs work but also learn how to adapt them. All developed examples can be run on a regular laptop.

About the Technology

Following the principle "I cannot understand what I cannot build," you will learn the process of creating a GPT-style LLM from scratch. Without using pre-built libraries, you will design a basic model, configure it for text classification, and eventually create a chatbot that can follow your instructions.

About the Book

"Building a Large Language Model from Scratch" is an engaging practical course on the fundamentals of generative AI. At each stage, you will delve into theory, reinforcing your knowledge with real development, giving you a deep understanding of the workings and limitations of LLMs.

Who the Book is For:

The book is suitable for readers with an intermediate level of Python and basic knowledge of machine learning. All developed models will work on any modern laptop, with the possibility of using a GPU.