Multimodal Generative AI: worked example and design decisions | Complete Generative AI: From Foundations to Production
A self-paced 26-week learning path with 15 modules: AI foundations, Python, machine learning, transformers, LLMs, prompts, APIs, embeddings, RAG, frameworks, agents, customization, multimodal AI, Spring Boot with React, and production LLMOps. Includes 15 practical assignments and three portfolio projects.
Prerequisites: Begin with basic computer skills. Programming is introduced in Weeks 2–3. Use a local Python environment for coding labs; Java and React experience helps in Weeks 21–22. Model downloads, provider accounts and deployment resources are optional learner-managed dependencies. The 26-week schedule is suggested; reading estimates exclude independent project work.
Walk through an example
An image-description assistant should distinguish visible evidence from inference. "A laptop is on a desk" may be supported, while "this person is a senior engineer" is not established by the image. A voice assistant should show the recognized transcript before using it for a consequential action. The mock below tests file metadata and contract shape; production validation must inspect bytes safely and use real decoders with resource limits, because client-provided metadata can be forged.
def mock_describe(meta):
if meta.get("type") not in {"image/png", "image/jpeg"}:
raise ValueError("unsupported image type")
if not 0 < meta.get("bytes", 0) <= 2_000_000:
raise ValueError("invalid image size")
return {"description": "Mock description for UI testing", "mock": True}
print(mock_describe({"type": "image/png", "bytes": 1200}))
Expected behavior
{'description': 'Mock description for UI testing', 'mock': True} Read the example before adapting it. The code is displayed for study and local use; the academy does not execute it or contact an AI provider.
Review the boundary
List the assumptions in this example and identify which inputs come from an untrusted caller. Change one assumption at a time and write the expected behavior before running a local experiment. Preserve both successful and failed cases in your project notes. A demonstration that works once does not establish accuracy, security or production readiness.
01. Introduction to Artificial Intelligence · Week 1
02. Python Programming for Gen AI · Weeks 2–3
03. Mathematics and Machine Learning Foundations · Week 4
04. Deep Learning and Transformers · Weeks 5–6
05. Large Language Models (LLMs) · Weeks 7–8
06. Prompt Engineering · Weeks 9–10
07. Generative AI APIs and Application Development · Week 11
08. Embeddings and Vector Databases · Weeks 12–13
09. Retrieval-Augmented Generation (RAG) · Weeks 14–15
10. LangChain, LlamaIndex and AI Frameworks · Week 16
11. AI Agents and Agentic AI · Weeks 17–18
12. Fine-Tuning and Model Customization · Week 19
13. Multimodal Generative AI · Week 20
14. Gen AI with Java Spring Boot and React · Weeks 21–22
15. Production Gen AI, LLMOps and Capstone · Weeks 23–26