System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

All designs 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

RecoveryClear filters

111. Design Checkpointing for a 10,000-GPU Training Run
Save the 1 TB state of a 70 B model on 10,000 GPUs often enough that a failure costs minutes, without stalling training, and restore fast.
ClassicMedium
Machine learning AI infrastructure AWS
+4
Checkpointing Recovery Storage Training
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.