← All paths

Path 02 · full reference map

AI Systems & Inference Engineering

The complete path from ML foundations and transformer internals to efficient, observable, distributed AI infrastructure.

10 modules80 topicsSelf-pacedAI systems mastery guide

Prior practice · disclosed carefully

I am not starting this path at zero.

These claims come from résumé-backed work. They are intentionally generalized, so the site shows what I have applied without inventing public artifacts or exposing private systems.

Agent intelligence

Built an AI classifier that turns trace behavior into structured insights and routes work between models and deterministic code.

Evaluation systems

Built failure taxonomies, automated evaluation workflows, regression detection, and quality monitoring with RAGAS and Langfuse.

Production optimization

Applied routing decisions to reduce unnecessary model calls and improve cost and latency at the orchestration layer.

Published progress

8%

6 of 80 topics complete · updated with each site release

01

Quarter 01

Machine-learning foundations

Build enough mathematical and implementation fluency to reason about model behavior.

0/8
Linear algebra for MLNot yet published
Probability and statisticsNot yet published
Gradient descentNot yet published
BackpropagationNot yet published
Loss functionsNot yet published
RegularizationNot yet published
OptimizationNot yet published
PyTorch autogradNot yet published
02

Quarter 01

Transformer internals

Follow the model from tokens through attention and generation.

0/8
TokenizationNot yet published
EmbeddingsNot yet published
Self-attentionNot yet published
Multi-head attentionNot yet published
Positional encoding and RoPENot yet published
Transformer blocksNot yet published
KV cacheNot yet published
Sampling and decodingNot yet published
03

Quarter 01

Retrieval systems

Build retrieval as an evaluated information system, not a demo feature.

0/8
Embedding modelsNot yet published
Chunking strategiesNot yet published
HNSWNot yet published
IVF and FAISSNot yet published
Hybrid searchNot yet published
RerankingNot yet published
RAG architecturesNot yet published
Retrieval evaluationNot yet published
04

Quarter 02

LLM applications and agents

Design controllable application loops around probabilistic models.

0/8
Prompt designNot yet published
Structured outputsNot yet published
Tool callingNot yet published
Agent loopsNot yet published
Memory patternsNot yet published
Planning and routingNot yet published
MCPNot yet published
Durable agent workflowsNot yet published
05

Quarter 02

Evaluation

Make quality measurable across prompts, models, retrieval, and agents.

3/8
Offline evaluationNot yet published
Online evaluationNot yet published
Golden datasetsNot yet published
RAGAS metricsPracticed · complete
Trace evaluationPracticed · complete
LLM-as-judgeNot yet published
Regression detectionPracticed · complete
Human review loopsNot yet published
06

Quarter 03

Inference engineering

Understand latency, throughput, memory, and scheduling at serving time.

1/8
Prefill and decodeNot yet published
TTFT and TPOTNot yet published
Continuous batchingNot yet published
Paged attentionNot yet published
QuantizationNot yet published
Speculative decodingNot yet published
Tensor and pipeline parallelismNot yet published
Model routingPracticed · complete
07

Quarter 03

GPU and kernel foundations

Connect serving behavior to memory movement and compute.

0/8
GPU architectureNot yet published
Memory hierarchyNot yet published
CUDA execution modelNot yet published
Kernel profilingNot yet published
FlashAttentionNot yet published
Custom operationsNot yet published
Roofline analysisNot yet published
Communication collectivesNot yet published
08

Quarter 03

Distributed training

Study scale, faults, and communication across training clusters.

0/8
Data parallelismNot yet published
FSDPNot yet published
DeepSpeed ZeRONot yet published
CheckpointingNot yet published
Fault toleranceNot yet published
Gradient accumulationNot yet published
Mixed precisionNot yet published
Training observabilityNot yet published
09

Quarter 04

Production AI platform

Operate AI as a reliable multi-tenant system.

2/8
Model gatewaysNot yet published
AutoscalingNot yet published
Semantic cachingNot yet published
Cost attributionPracticed · complete
Safety and guardrailsNot yet published
AI observabilityPracticed · complete
Kubernetes deploymentNot yet published
SLOs and incident responseNot yet published
10

Quarter 04

Systems builds

Consolidate the path in complete engineering artifacts.

0/8
Neural network from scratchNot yet published
Vector databaseNot yet published
Production RAG systemNot yet published
Distributed key-value storeNot yet published
LLM inference serverNot yet published
CUDA kernelNot yet published
Distributed training pipelineNot yet published
AI observability platformNot yet published