Skip to main content
CF

Building LLMs for Production

0h 0m 0s
English
Paid

Building LLMs for Production is a self-paced course by Louis-François Bouchard, Towards AI. Creating LLM for Production is a comprehensive 470-page guide (updated in October 2024) crafted for developers and specialists aiming to transcend prototyping and develop robust, industry-ready applications based on large language models…

Course facts

Language
English
Instructor
Louis-François Bouchard, Towards AI
Price
Premium

Creating LLM for Production is a comprehensive 470-page guide (updated in October 2024) crafted for developers and specialists aiming to transcend prototyping and develop robust, industry-ready applications based on large language models.

Understanding the Fundamentals of LLMs

This guide elucidates the core principles of how large language models (LLMs) operate, providing a solid foundation for building advanced applications.

Key Techniques Explored

The book delves into a variety of essential techniques needed to harness the full potential of LLMs, including:

  • Advanced Prompting: Mastering the art of effectively instructing LLMs to achieve precise outcomes.
  • Retrieval-Augmented Generation (RAG): Exploring techniques that combine information retrieval and generative models.
  • Model Fine-Tuning: Detailed methods for customizing LLMs to specific tasks or domains.
  • Evaluation Methods: Comprehensive approaches for assessing model performance and accuracy.
  • Deployment Strategies: Proven tactics for integrating LLMs into live production environments.

Practical Tools and Resources

Readers benefit from hands-on resources, including:

  • Interactive Colab Notebooks for practical experimentation.
  • Real-world code examples to illustrate key concepts in action.
  • Case Studies that demonstrate how to successfully integrate LLMs into existing products and workflows.

Addressing Critical Challenges

This guide also pays special attention to:

  • Security: Safeguarding applications and data when using LLMs.
  • Monitoring: Keeping track of model performance and system health.
  • Optimization: Enhancing efficiency and effectiveness of LLM implementations.
  • Cost Reduction: Strategies to minimize operational costs in LLM deployment.

Who teaches Building LLMs for Production?

Louis-François Bouchard

Louis-François Bouchard thumbnail

Louis-François Bouchard is a French-Canadian AI engineer and educator behind the What's AI newsletter and YouTube channel — one of the more accessible explainer sources on modern AI research. He is also the lead instructor for several courses on the Towards AI platform, where he teaches the production-engineering side of LLM applications.

His CourseFlix listing carries six Louis-François Bouchard courses spanning the applied AI track: Building LLMs for Production, 10-Hour LLM Fundamentals, Build Your First Product with LLMs / Prompting / RAG, Master AI for Work, Beginner Python Primer for AI Engineering, and the Agentic AI Engineering Course.

Material is paid and aimed at engineers picking up applied LLM work as a serious skill. For broader content, see CourseFlix's LLMs & Fundamentals, RAG, and AI Agents category pages.

Towards AI

Towards AI thumbnail

Towards AI is one of the larger AI-focused publishers on the open web — originally a Medium publication and now a multi-author content platform plus a paid course catalog focused on production LLM engineering. The brand has tracked the post-ChatGPT generative-AI wave from inside the field rather than from a generic SaaS-marketing perspective.

The CourseFlix listing reflects their applied focus: Building LLMs for Production, 10-Hour LLM Fundamentals, Build Your First Product with LLMs, Prompting, RAG, the Agentic AI Engineering Course, Beginner Python Primer for AI Engineering, and Master AI for Work. Material is paid and aimed at engineers who already know Python and want to ship production AI features rather than read a survey of the field.

Books

Read Book Building LLMs for Production

#TitleTypeOpen
1Table of Contents —
2About The Book —
3Introduction —
4Why Prompt Engineering, Fine-Tuning, and RAG? —
5Coding Environment and Packages —
6A Brief History of Language Models —
7What are Large Language Models? —
8Building Blocks of LLMs —
9Tutorial: Translation with LLMs (GPT-3.5 API) —
10Tutorial: Control LLMs Output with Few-Shot Learning —
11Recap —
12Understanding Transformers —
13Transformer Model’s Design Choices —
14Transformer Architecture Optimization Techniques —
15The Generative Pre-trained Transformer (GPT) Architecture —
16Introduction to Large Multimodal Models —
17Proprietary vs. Open Models vs. Open-Source Language Models —
18Applications and Use-Cases of LLMs —
19Recap —
20Understanding Hallucinations and Bias —
21Reducing Hallucinations by Controlling LLM Outputs —
22Evaluating LLM Performance —
23Recap —
24Prompting and Prompt Engineering —
25Prompting Techniques —
26Prompt Injection and Security —
27Recap —
28Why RAG? —
29Building a Basic RAG Pipeline from Scratch —
30Recap —
31LLM Frameworks —
32LangChain Introduction —
33Tutorial 1: Building LLM-Powered Applications with LangChain —
34Tutorial 2: Building a News Articles Summarizer —
35LlamaIndex Introduction —
36LangChain vs. LlamaIndex vs. OpenAI Assistants —
37Recap —
38What are LangChain Prompt Templates —
39Few-Shot Prompts and Example Selectors —
40What are LangChain Chains —
41Tutorial 1: Managing Outputs with Output Parsers —
42Tutorial 2: Improving Our News Articles Summarizer —
43Tutorial 3: Creating Knowledge Graphs from Textual Data: Finding Hidden Connections —
44Recap —
45LangChain’s Indexes and Retrievers —
46Data Ingestion —
47Text Splitters —
48Similarity Search and Vector Embeddings —
49Tutorial 1: A Customer Support Q&A Chatbot —
50Tutorial 2: A YouTube Video Summarizer Using Whisper and LangChain —
51Tutorial 3: A Voice Assistant for Your Knowledge Base —
52Tutorial 4: Preventing Undesirable Outputs with the Self-Critique Chain —
53Tutorial 5: Preventing Undesirable Outputs from a Customer Service Chatbot —
54Recap —
55From Proof of Concept to Product: Challenges of RAG Systems —
56Advanced RAG Techniques with LlamaIndex —
57RAG - Metrics & Evaluation —
58LangChain LangSmith and LangChain Hub —
59Recap —
60What are Agents: Large Models as Reasoning Engines —
61An Overview of AutoGPT and BabyAGI —
62The Agent Simulation Projects in LangChain —
63Tutorial 1: Building Agents for Analysis Report Creation —
64Tutorial 2: Query and Summarize a DB with LlamaIndex —
65Tutorial 3: Building Agents with OpenAI Assistants —
66Tutorial 4: LangChain OpenGPT —
67Tutorial 5: Multimodal Financial Document Analysis from PDFs —
68Recap —
69Understanding Fine-Tuning —
70Low-Rank Adaptation (LoRA) —
71Tutorial 1: SFT with LoRA —
72Tutorial 2: Using SFT and LoRA for Financial Sentiment —
73Tutorial 3: Fine-Tuning a Cohere LLM with Medical Data —
74Reinforcement Learning from Human Feedback —
75Tutorial 4: Improving LLMs with RLHF —
76Recap —
77Model Distillation and Teacher-Student Models —
78LLM Deployment Optimization: Quantization, Pruning, and Speculative Decoding —
79Tutorial: Deploying a Quantized LLM on a CPU on Google Cloud Platform (GCP) —
80Deploying Open-Source LLMs on Cloud Providers —
81Recap —
82Conclusion —
83Further Reading and Courses —

What courses are similar to Building LLMs for Production?

More courses by Louis-François Bouchard

Frequently asked questions

What is Building LLMs for Production about?
Creating LLM for Production is a comprehensive 470-page guide (updated in October 2024) crafted for developers and specialists aiming to transcend prototyping and develop robust, industry-ready applications based on large language models…
Who teaches this course?
It is taught by Louis-François Bouchard, Towards AI. You can find more courses by these instructors on the corresponding source pages.
How long is the course?
It is delivered as a self-paced online course on CourseFlix.
Is it free to watch?
It is part of CourseFlix's premium catalog. A subscription unlocks the full video player; the course description, table of contents, and preview information are available to everyone.
Where can I watch it online?
The course is available to watch online on CourseFlix at https://courseflix.net/course/building-llms-for-production. The page hosts every lesson with the integrated video player; no download is required.