System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

All designs 2

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

DeploymentClear filters

Practice briefStart with your own approach
19. Ship a cheaper model without hiding regressions
Build a release decision from noisy evaluations, customer slices and production feedback.
Machine learningMedium
Machine learning Cost Deployment
+2
Evaluation Rollback
Discuss
Practice
107. Design an ML Model Serving and Deployment Platform
From registry to traffic for hundreds of models: gates, shadow and canary with automatic rollback, packed CPU and GPU pools, LLM serving, cells and audit.
ClassicMedium
AI infrastructure AWS Deployment
+2
MLOps Serving
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.