System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

Designs with worked examples 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

EvaluationClear filters

121. Design an LLM Evaluation Platform
GPU batch generation behind a shared cache, sandboxed pass@k, calibrated judges, paired statistics, release gates, contamination checks.
ClassicMedium
Generative AI AI infrastructure AWS
+3
Evaluation LLMs MLOps
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.