System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

All designs 2

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

EvaluationClear filters

Practice briefStart with your own approach
19. Ship a cheaper model without hiding regressions
Build a release decision from noisy evaluations, customer slices and production feedback.
Machine learningMedium
Machine learning Cost Deployment
+2
Evaluation Rollback
Discuss
Practice
121. Design an LLM Evaluation Platform
GPU batch generation behind a shared cache, sandboxed pass@k, calibrated judges, paired statistics, release gates, contamination checks.
ClassicMedium
Generative AI AI infrastructure AWS
+3
Evaluation LLMs MLOps
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.