System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

All designs 2

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

GPUsClear filters

102. Design a GPU Cluster Scheduler for Training Jobs
Thousands of GPUs shared by many teams: gang admission, topology-aware placement, quotas with lending, checkpointed preemption and failure recovery.
ClassicMedium
AI infrastructure AWS GPUs
+2
Kubernetes Scheduling
Worked design
Practice
117. Design a Self-Healing GPU Fleet
Detect, classify and repair failing GPU nodes (Xid errors, ECC, NVLink and EFA faults, stragglers, silent corruption) without draining the fleet.
ClassicMedium
Observability AI infrastructure AWS
+2
GPUs Reliability
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.