Large Language Models (LLMs): worked example and design decisions | Complete Generative AI: From Foundations to Production
A self-paced 26-week learning path with 15 modules: AI foundations, Python, machine learning, transformers, LLMs, prompts, APIs, embeddings, RAG, frameworks, agents, customization, multimodal AI, Spring Boot with React, and production LLMOps. Includes 15 practical assignments and three portfolio projects.
Prerequisites: Begin with basic computer skills. Programming is introduced in Weeks 2–3. Use a local Python environment for coding labs; Java and React experience helps in Weeks 21–22. Model downloads, provider accounts and deployment resources are optional learner-managed dependencies. The 26-week schedule is suggested; reading estimates exclude independent project work.
Walk through an example
For an approximate lower bound, a three-billion-parameter model at four bits per parameter has about 1.5 billion bytes of raw weights. Loading still needs additional memory for quantization metadata, caches and the runtime. Select candidates using task-specific tests, license terms, supported languages, privacy needs and latency on your actual hardware. Measure time to first token separately from full completion time, and record failures instead of comparing only polished demonstration answers.
def raw_weight_gib(parameters, bits):
return parameters * bits / 8 / (1024 ** 3)
for bits in (16, 8, 4):
print(bits, round(raw_weight_gib(3_000_000_000, bits), 2))
Expected behavior
16 5.59
8 2.79
4 1.4
These are raw-weight estimates, not total RAM requirements. Read the example before adapting it. The code is displayed for study and local use; the academy does not execute it or contact an AI provider.
Review the boundary
List the assumptions in this example and identify which inputs come from an untrusted caller. Change one assumption at a time and write the expected behavior before running a local experiment. Preserve both successful and failed cases in your project notes. A demonstration that works once does not establish accuracy, security or production readiness.
Hugging Face: quantization concepts
01. Introduction to Artificial Intelligence · Week 1
02. Python Programming for Gen AI · Weeks 2–3
03. Mathematics and Machine Learning Foundations · Week 4
04. Deep Learning and Transformers · Weeks 5–6
05. Large Language Models (LLMs) · Weeks 7–8
06. Prompt Engineering · Weeks 9–10
07. Generative AI APIs and Application Development · Week 11
08. Embeddings and Vector Databases · Weeks 12–13
09. Retrieval-Augmented Generation (RAG) · Weeks 14–15
10. LangChain, LlamaIndex and AI Frameworks · Week 16
11. AI Agents and Agentic AI · Weeks 17–18
12. Fine-Tuning and Model Customization · Week 19
13. Multimodal Generative AI · Week 20
14. Gen AI with Java Spring Boot and React · Weeks 21–22
15. Production Gen AI, LLMOps and Capstone · Weeks 23–26