System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

Designs with worked examples 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

DistillationClear filters

126. Design Model Distillation at Scale
A 70B teacher distilled into an 8B student: transfer sets, logit and on-policy distillation, per-slice gates, escalation routing, a refresh loop.
ClassicMedium
Machine learning Generative AI AWS
+3
Distillation LLMs Training
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.