Appendix P: Keyword Index

An automatically generated index of key terms and their chapter locations.


**:

-** — Audio & Speech, Video & Multimodal

: 1.Prompt Engineering, Security

A

A1.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

A2.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

A3.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

A4.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

AccuracyML Fundamentals, Audio & Speech

agentAI Engineering Landscape, First LLM App, LLM/NLP Foundations, Prompt Engineering, RAG Systems (+12 more)

AgentsCloud AI Providers, Multi-Cloud Patterns

AgentStateOrchestration Frameworks, Observability & Guardrails

AI Incident DatabaseResponsible AI, Project Ownership

AnalysisOrchestration Frameworks, Observability & Guardrails, Performance

ArchitectureLLM Deployment, Audio & Speech, Data Architecture

Architecture Decision RecordsTechnical Communication, System Design, Decision Making

Ask clarifying questionsTechnical Communication, Mentorship

attentionAI Engineering Landscape, ML Fundamentals, LLM/NLP Foundations, Prompt Engineering, RAG Systems (+21 more)

B

batchingAI Engineering Landscape, ML Fundamentals, First LLM App, LLM/NLP Foundations, Prompt Engineering (+8 more)

BatchingLLM Deployment, System Design

Batching effectsML Fundamentals, Backend Engineering

Best ForCloud AI Providers, Multi-Cloud Patterns

Best ModelsCloud AI Providers, Multi-Cloud Patterns

BoundariesSecurity, Mentorship

Brown et al. (2020), “Language Models are Few-Shot Learners”AI Engineering Landscape, ML Fundamentals

Build vs. Buy Decision FrameworkDecision Making, Cost Engineering

C

CachingFirst LLM App, Data Architecture, Cost Engineering

Case StudiesCloud AI Providers, Research to Production, Reliability

chain-of-thoughtFirst LLM App, LLM/NLP Foundations, Prompt Engineering, Agentic Systems, MLOps & Evaluation (+1 more)

ChallengePrompt Engineering, Performance

Chapter 10 (Orchestration & Agent Frameworks)AI Engineering Landscape, Agentic Systems, Observability & Guardrails

Chapter 12 (Cloud AI Deployment)Orchestration Frameworks, Observability & Guardrails, Reliability

Chapter 14 (Backend Engineering for AI)Python for AI, First LLM App

Chapter 15 (Evaluation)First LLM App, Prompt Engineering

Chapter 15 (MLOps & Evaluation)ML Fundamentals, First LLM App, RAG Systems, Observability & Guardrails, Video & Multimodal (+4 more)

Chapter 15 (MLOps)Vision & Document AI, Responsible AI

Chapter 16 (Security & Adversarial Robustness)Agentic Systems, Observability & Guardrails, Multi-Cloud Patterns

Chapter 16 (Security)First LLM App, Responsible AI

Chapter 17 (Vision & Document AI)Audio & Speech, Video & Multimodal

Chapter 21 (Deepening Technical Expertise)Project Ownership, Mentorship, Research to Production

Chapter 22 (Project Ownership & Delivery)Technical Expertise, Technical Communication, Cross-Team Leadership

Chapter 23 (Technical Communication)Technical Expertise, Project Ownership, Mentorship, Decision Making, Research to Production (+1 more)

Chapter 23 (Technical Decision Making)Technical Expertise, Project Ownership, Technical Communication, Research to Production

Chapter 24 (Mentorship Foundations)Technical Expertise, Project Ownership, Technical Communication, Cross-Team Leadership

Chapter 25 (System Design at Scale)Project Ownership, Decision Making, Performance, Cross-Team Leadership, Data Architecture (+1 more)

Chapter 26 (Cross-Team Technical Leadership)Technical Communication, Mentorship, Decision Making

Chapter 27 (Performance Engineering)ML Fundamentals, LLM Deployment, System Design, Research to Production, Cost Engineering

Chapter 30 (Data Architecture for AI)RAG Systems, MLOps & Evaluation

Chapter 31 (Reliability Engineering)Python for AI, Agentic Systems, Cloud AI Providers, Multi-Cloud Patterns, System Design (+2 more)

Chapter 32 (Cost Engineering)LLM Deployment, Cloud AI Providers, Multi-Cloud Patterns, System Design, Decision Making (+3 more)

Chapter 4 (Your First LLM Application)AI Engineering Landscape, Python for AI

Chapter 5 (LLM Foundations)ML Fundamentals, Prompt Engineering, LLM Deployment, Vision & Document AI

Chapter 5 (LLM/NLP Foundations)AI Engineering Landscape, ML Fundamentals, RAG Systems

Chapter 5: LLM/NLP FoundationsPrompt Engineering, LLM Deployment

Chapter 6 (Prompt Engineering)First LLM App, LLM/NLP Foundations, RAG Systems, Agentic Systems, LLM Deployment

Chapter 7 (RAG Systems)ML Fundamentals, First LLM App, LLM/NLP Foundations, Prompt Engineering, Agentic Systems (+9 more)

Chapter 8 (Agentic Systems)First LLM App, LLM/NLP Foundations, Prompt Engineering, RAG Systems, LLM Deployment (+3 more)

Chapter 9 (Deployment)First LLM App, LLM/NLP Foundations, Vision & Document AI

Chapter 9 (LLM Deployment & Infrastructure)Python for AI, Cloud AI Providers, Multi-Cloud Patterns, System Design, Performance (+4 more)

Check Your AnswersFirst LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

chunkingAI Engineering Landscape, Python for AI, First LLM App, RAG Systems, Agentic Systems (+8 more)

CircuitBreakerSystem Design, Reliability

Cold storageBackend Engineering, MLOps & Evaluation

Common Failure PatternsAgentic Systems, Research to Production

Common Pitfalls and How to Avoid ThemPerformance, Cross-Team Leadership, Data Architecture

Communicating UncertaintyProject Ownership, Technical Communication

Complete codeFirst LLM App, Video & Multimodal

ComplianceCloud AI Providers, Multi-Cloud Patterns, Data Architecture

CompositionalityVision & Document AI, Video & Multimodal

Conceptual QuestionsAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+27 more)

Connections to Other ChaptersAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+27 more)

ConsVision & Document AI, System Design

ConsistencyLLM/NLP Foundations, MLOps & Evaluation, System Design

ContextFirst LLM App, Prompt Engineering, Backend Engineering, Audio & Speech, Mentorship (+2 more)

context windowAI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+5 more)

Continuous batchingLLM/NLP Foundations, LLM Deployment, System Design, Performance, Cost Engineering

Contrastive learningML Fundamentals, RAG Systems

ControlOrchestration Frameworks, Cloud AI Providers

CorrectnessMLOps & Evaluation, Technical Communication

Cosine similarityFirst LLM App, RAG Systems

CostAI Engineering Landscape, First LLM App, Cloud AI Providers, MLOps & Evaluation, Audio & Speech

Cost Optimization StrategiesData Architecture, Cost Engineering

Cost TrackingFirst LLM App, Observability & Guardrails

Course correctionAgentic Systems, Mentorship

CriticalSecurity, Responsible AI

CustomizationAI Engineering Landscape, Cloud AI Providers

D

Dao et al. (2022), “FlashAttention”Performance, Research to Production

Data EngineersAI Engineering Landscape, Project Ownership

Data leakageML Fundamentals, Data Architecture

Data privacyAI Engineering Landscape, Decision Making

Decision frameworkPrompt Engineering, RAG Systems

Decision FrameworkLLM Deployment, Observability & Guardrails

Decision FrameworksBackend Engineering, MLOps & Evaluation

Decision recordsTechnical Expertise, Mentorship

Deep DivesAI Engineering Landscape, ML Fundamentals, First LLM App, LLM/NLP Foundations, Prompt Engineering (+22 more)

Deep Dives (For Specialists)LLM Deployment, Responsible AI

Define criteriaML Fundamentals, Decision Making

DeploymentFirst LLM App, Cloud AI Providers

Design ExercisesAI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+20 more)

Detailed DesignTechnical Communication, Decision Making

DirectnessTechnical Communication, Mentorship

DocumentedMLOps & Evaluation, Project Ownership

DrawbacksTechnical Communication, Decision Making

E

EfficiencyFirst LLM App, LLM/NLP Foundations, MLOps & Evaluation

embeddingAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+24 more)

EmbeddingsML Fundamentals, LLM/NLP Foundations

Enterprise FeaturesOrchestration Frameworks, Cloud AI Providers

Error handlingOrchestration Frameworks, Technical Communication

Error recoveryAgentic Systems, Video & Multimodal

EssentialAI Engineering Landscape, ML Fundamentals, First LLM App, LLM/NLP Foundations, Prompt Engineering (+22 more)

Essential (Read These)LLM Deployment, Responsible AI

EvaluationML Fundamentals, RAG Systems

Evaluation and Quality AssuranceVision & Document AI, Video & Multimodal

ExampleSecurity, Responsible AI

Example calculationLLM Deployment, Reliability

Exercise 1. [Senior]AI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+13 more)

Exercise 1. [Staff]System Design, Decision Making, Performance, Reliability, Cost Engineering

Exercise 2. [Staff]AI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+18 more)

Exercise 3: Build vs. Buy AnalysisDecision Making, Cost Engineering

Exercise 4: Incident Response SimulationResponsible AI, Reliability

F

Failure analysisFirst LLM App, RAG Systems, Agentic Systems

Feedback loopsData Architecture, Reliability

few-shotAI Engineering Landscape, ML Fundamentals, First LLM App, LLM/NLP Foundations, Prompt Engineering (+5 more)

fine-tuningAI Engineering Landscape, ML Fundamentals, LLM/NLP Foundations, Prompt Engineering, RAG Systems (+12 more)

Fine-tuningCloud AI Providers, Multi-Cloud Patterns

FixPrompt Engineering, RAG Systems, Agentic Systems, LLM Deployment, Security (+2 more)

Fix:LLM/NLP Foundations, Prompt Engineering, Orchestration Frameworks, Observability & Guardrails, Cloud AI Providers (+13 more)

Flash AttentionLLM/NLP Foundations, Performance

Follow upTechnical Communication, Mentorship

Full implementationPrompt Engineering, RAG Systems, Agentic Systems, LLM Deployment, Backend Engineering (+5 more)

function callingAI Engineering Landscape, Prompt Engineering, Agentic Systems, Observability & Guardrails, Cloud AI Providers (+1 more)

Further ReadingAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+24 more)

G

GeneratesRAG Systems, Performance

Graceful degradationAgentic Systems, LLM Deployment

Graceful DegradationBackend Engineering, Reliability

Grouped-Query Attention (GQA)LLM/NLP Foundations, Performance

Growth Areas:Project Ownership, Research to Production

guardrailsAI Engineering Landscape, ML Fundamentals, Prompt Engineering, Agentic Systems, Orchestration Frameworks (+5 more)

H

hallucinationAI Engineering Landscape, ML Fundamentals, First LLM App, Prompt Engineering, RAG Systems (+7 more)

Handling DisagreementsProject Ownership, Research to Production

HaystackAI Engineering Landscape, Orchestration Frameworks

HighSecurity, Responsible AI

Historical ContextLLM Deployment, Orchestration Frameworks

HNSW (Hierarchical Navigable Small World)First LLM App, RAG Systems

Hot storageBackend Engineering, MLOps & Evaluation

How they fixed itPrompt Engineering, RAG Systems, Reliability

Human evaluationML Fundamentals, MLOps & Evaluation

Human-in-the-loopPrompt Engineering, Security

Hybrid approachAgentic Systems, Decision Making

Hybrid searchAI Engineering Landscape, First LLM App, RAG Systems

I

ImpactMentorship, System Design

Implement cachingFirst LLM App, Cloud AI Providers

inferenceAI Engineering Landscape, Python for AI, ML Fundamentals, LLM/NLP Foundations, Prompt Engineering (+20 more)

Integration PatternsObservability & Guardrails, Backend Engineering

InterpretabilityML Fundamentals, Agentic Systems

Interview PreparationAI Engineering Landscape, Mentorship

IntroductionAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+26 more)

K

Kahneman (2011), “Thinking, Fast and Slow”Technical Expertise, Project Ownership

Keshav (2007), “How to Read a Paper”Technical Expertise, Research to Production

Key differencesPrompt Engineering, RAG Systems, Agentic Systems, LLM Deployment, Security (+2 more)

Key insightPrompt Engineering, LLM Deployment, System Design, Reliability

Key insightsMentorship, Performance

Key PrinciplesOrchestration Frameworks, Observability & Guardrails

Key TakeawaysFirst LLM App, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+17 more)

Kleppmann (2017), “Designing Data-Intensive Applications”Backend Engineering, Data Architecture

KV cacheAI Engineering Landscape, LLM/NLP Foundations, LLM Deployment, Responsible AI, Technical Expertise (+3 more)

KV cachingLLM/NLP Foundations, LLM Deployment, System Design

Kwon et al. (2023), “PagedAttention”Backend Engineering, System Design

Kwon et al. (2023), “PagedAttention/vLLM”Research to Production, Cost Engineering

L

LangChainAI Engineering Landscape, Orchestration Frameworks

LangfuseAI Engineering Landscape, Observability & Guardrails

LangSmithAI Engineering Landscape, Observability & Guardrails

LatencyAI Engineering Landscape, Cloud AI Providers, Audio & Speech

latencyAI Engineering Landscape, Python for AI, First LLM App, LLM/NLP Foundations, Prompt Engineering (+25 more)

Legal and ComplianceAI Engineering Landscape, Project Ownership

LlamaIndexAI Engineering Landscape, Orchestration Frameworks

LLMAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+26 more)

LLM Provider ComparisonCloud AI Providers, Cost Engineering

LowSecurity, Responsible AI

M

MaintainabilityMLOps & Evaluation, Research to Production

Market PositionOrchestration Frameworks, Observability & Guardrails

MediumSecurity, Responsible AI

Memory bandwidth is the bottleneckLLM Deployment, Performance

memory-bandwidth boundLLM Deployment, System Design

Migration StrategiesOrchestration Frameworks, Data Architecture

Mitigation strategiesPrompt Engineering, RAG Systems, System Design, Decision Making

Model sizeSystem Design, Cost Engineering

Model updatesML Fundamentals, Backend Engineering

MotivationTechnical Communication, Decision Making

Multi-Query Attention (MQA)LLM/NLP Foundations, Performance

MultilingualRAG Systems, Audio & Speech

N

NIST AI Risk Management FrameworkSecurity, Responsible AI

Non-determinismAI Engineering Landscape, MLOps & Evaluation

O

ObservabilityOrchestration Frameworks, Observability & Guardrails

OpenAIAI Engineering Landscape, First LLM App

OutcomeMentorship, Decision Making

P

PagedAttentionLLM Deployment, System Design, Performance

Patterson et al., “Crucial Conversations”Technical Communication, Cross-Team Leadership

PerformanceOrchestration Frameworks, Observability & Guardrails, Technical Communication

PhilosophyOrchestration Frameworks, Observability & Guardrails

Practical ExercisesAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+27 more)

Practical implicationsML Fundamentals, System Design

Practical ResourcesBackend Engineering, Vision & Document AI, Responsible AI, Project Ownership, Technical Communication (+2 more)

PrerequisitesFirst LLM App, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+20 more)

PreventionResponsible AI, Project Ownership

Principle of least privilegeAgentic Systems, Security

Problem 1. [IC2]AI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+16 more)

Problem 1. [Senior]System Design, Decision Making, Performance, Reliability, Cost Engineering

Problem 2. [Senior]AI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+16 more)

Problem 2. [Staff]System Design, Decision Making, Performance, Reliability, Cost Engineering

Problem 3. [Staff]AI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+21 more)

Product ManagersAI Engineering Landscape, Project Ownership

Production Architecture PatternsVision & Document AI, Video & Multimodal

Production ConsiderationsRAG Systems, Agentic Systems, Vision & Document AI

promptAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+25 more)

prompt injectionAI Engineering Landscape, First LLM App, Prompt Engineering, Agentic Systems, Observability & Guardrails (+6 more)

Prompt optimizationFirst LLM App, Cost Engineering

ProsVision & Document AI, System Design

Q

Q1.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

Q1. [IC1]ML Fundamentals, First LLM App

Q1. [IC2]AI Engineering Landscape, Python for AI, LLM/NLP Foundations, Prompt Engineering, RAG Systems (+17 more)

Q1. [Senior]System Design, Decision Making, Performance, Reliability, Cost Engineering

Q2.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

Q2. [IC1]ML Fundamentals, First LLM App

Q2. [IC2]AI Engineering Landscape, Python for AI, LLM/NLP Foundations, Prompt Engineering, RAG Systems (+17 more)

Q2. [Senior]System Design, Decision Making, Performance, Reliability, Cost Engineering

Q3.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

Q3. [IC2]ML Fundamentals, First LLM App

Q3. [Senior]AI Engineering Landscape, Python for AI, LLM/NLP Foundations, Prompt Engineering, RAG Systems (+17 more)

Q3. [Staff]System Design, Decision Making, Performance, Reliability, Cost Engineering

Q4.First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

Q4. [IC2]ML Fundamentals, First LLM App

Q4. [Senior]AI Engineering Landscape, Python for AI, LLM/NLP Foundations, Prompt Engineering, RAG Systems (+17 more)

Q4. [Staff]System Design, Decision Making, Performance, Reliability, Cost Engineering

Q5. [Senior]ML Fundamentals, First LLM App

Q5. [Staff]AI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+21 more)

Quality Indicators:Technical Expertise, Project Ownership, Research to Production, Data Architecture

quantizationAI Engineering Landscape, ML Fundamentals, LLM/NLP Foundations, RAG Systems, LLM Deployment (+8 more)

QuantizationLLM Deployment, System Design, Performance, Cost Engineering

Questions to askOrchestration Frameworks, Responsible AI

Quick Self-Test (10 minutes)First LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

R

Radford et al. (2021), “CLIP”Vision & Document AI, Video & Multimodal

RAGAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+27 more)

RAG SupportCloud AI Providers, Multi-Cloud Patterns

Read carefully ifPython for AI, ML Fundamentals

Read-only filesystemAgentic Systems, Security

Real-World Case StudiesSecurity, Mentorship

RecommendationVision & Document AI, Technical Communication

Recommended ReadingLLM Deployment, Responsible AI

ReliabilityAI Engineering Landscape, Observability & Guardrails, Research to Production

ReproducibilityLLM/NLP Foundations, Data Architecture

RequirementsObservability & Guardrails, Cost Engineering

RerankingAI Engineering Landscape, First LLM App, RAG Systems

rerankingAI Engineering Landscape, ML Fundamentals, First LLM App, LLM/NLP Foundations, RAG Systems (+4 more)

ResultsPrompt Engineering, Vision & Document AI, Audio & Speech

Risk Assessment MatrixSecurity, Project Ownership

RLHFML Fundamentals, LLM/NLP Foundations, MLOps & Evaluation, Technical Expertise, Research to Production

Root causePrompt Engineering, RAG Systems, Reliability

S

SafetyAgentic Systems, MLOps & Evaluation

ScaleAI Engineering Landscape, LLM/NLP Foundations, Security

ScenarioRAG Systems, Cost Engineering

Sculley et al. (2015), “Hidden Technical Debt in ML Systems”Project Ownership, Research to Production, Data Architecture, Reliability

See AlsoPrompt Engineering, LLM Deployment

Self-Assessment CheckpointAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+27 more)

Self-Assessment Questions:Technical Expertise, Project Ownership, Research to Production, Data Architecture

SemanticCacheSystem Design, Cost Engineering

SituationMentorship, Decision Making, Performance

Skills ChecklistFirst LLM App, Agentic Systems, Responsible AI, Mentorship, Cost Engineering

Skim instead ifPython for AI, ML Fundamentals

Skip This Chapter If…Python for AI, ML Fundamentals

Speculative decodingLLM Deployment, Performance, Cost Engineering

SpeedLLM Deployment, MLOps & Evaluation

Spot the ProblemAI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems (+24 more)

Staff Engineer PerspectiveLLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems, LLM Deployment (+18 more)

Stage 1: NoviceTechnical Expertise, Mentorship

Stage 2: Advanced BeginnerTechnical Expertise, Mentorship

Stage 3: CompetentTechnical Expertise, Mentorship

Stage 4: ProficientTechnical Expertise, Mentorship

Stage 5: ExpertTechnical Expertise, Mentorship

Start simpleAgentic Systems, Orchestration Frameworks

State ManagementAgentic Systems, Orchestration Frameworks

streamingAI Engineering Landscape, Python for AI, First LLM App, Prompt Engineering, Agentic Systems (+14 more)

SummaryAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+27 more)

T

TaskOrchestration Frameworks, Observability & Guardrails, MLOps & Evaluation

temperaturePython for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations, Prompt Engineering (+13 more)

Tensor ParallelismSystem Design, Performance

The ContendersOrchestration Frameworks, Observability & Guardrails

The Curse of KnowledgeTechnical Communication, Mentorship

The fixPerformance, Data Architecture

The Lost-in-the-Middle ProblemPrompt Engineering, RAG Systems

The novelTechnical Communication, Decision Making

The patternLLM/NLP Foundations, Prompt Engineering, RAG Systems, Agentic Systems, LLM Deployment (+2 more)

The situationPrompt Engineering, RAG Systems

The Speculative Decoding InsightLLM Deployment, Performance

The takeawayPrompt Engineering, RAG Systems, Reliability

Theoretical FoundationsAgentic Systems, Vision & Document AI, Reliability

throughputAI Engineering Landscape, Python for AI, LLM/NLP Foundations, Prompt Engineering, LLM Deployment (+13 more)

tokenAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+24 more)

tokenizationAI Engineering Landscape, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Audio & Speech (+5 more)

Tool & Framework ReferencePython for AI, Orchestration Frameworks, Observability & Guardrails, Performance

Tool Recommendations: As of January 2026Orchestration Frameworks, Observability & Guardrails

tool useAI Engineering Landscape, First LLM App, Prompt Engineering, Agentic Systems, Orchestration Frameworks (+5 more)

top-kML Fundamentals, LLM/NLP Foundations, Prompt Engineering, RAG Systems, Orchestration Frameworks (+1 more)

top-pML Fundamentals, LLM/NLP Foundations, Prompt Engineering

TracesSystem Design, Performance

transformerAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+15 more)

Type SafetyOrchestration Frameworks, Observability & Guardrails

U

Unresolved QuestionsTechnical Communication, Decision Making

V

Vaswani et al. (2017), “Attention Is All You Need”AI Engineering Landscape, ML Fundamentals, LLM/NLP Foundations

vector searchAI Engineering Landscape, ML Fundamentals, First LLM App, RAG Systems, Orchestration Frameworks (+4 more)

Visual conceptsVision & Document AI, Video & Multimodal

W

What happenedPrompt Engineering, RAG Systems, Reliability, Cost Engineering

What people doPrompt Engineering, RAG Systems, Agentic Systems, LLM Deployment, Security (+1 more)

What people do:LLM/NLP Foundations, Prompt Engineering, Orchestration Frameworks, Observability & Guardrails, Cloud AI Providers (+13 more)

What You’ll LearnAI Engineering Landscape, Python for AI, ML Fundamentals, First LLM App, LLM/NLP Foundations (+24 more)

When it failsRAG Systems, Responsible AI

When to Use WhatOrchestration Frameworks, Observability & Guardrails

Why it failsPrompt Engineering, RAG Systems, Agentic Systems, LLM Deployment, Security (+1 more)

Why it fails:LLM/NLP Foundations, Prompt Engineering, Orchestration Frameworks, Observability & Guardrails, Cloud AI Providers (+13 more)

Why it worksPrompt Engineering, System Design

Why Quantization WorksLLM Deployment, Performance

Why This Chapter MattersAI Engineering Landscape, Decision Making

Y

Yao et al. (2022), “ReAct: Synergizing Reasoning and Acting”Prompt Engineering, Agentic Systems

Z

zero-shotPrompt Engineering, Vision & Document AI

Zheng et al. (2023), “Judging LLM-as-a-Judge”ML Fundamentals, Backend Engineering, MLOps & Evaluation