System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

Designs with worked examples 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

DeploymentClear filters

107. Design an ML Model Serving and Deployment Platform
From registry to traffic for hundreds of models: gates, shadow and canary with automatic rollback, packed CPU and GPU pools, LLM serving, cells and audit.
ClassicMedium
AI infrastructure AWS Deployment
+2
MLOps Serving
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.