System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

All designs 3

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

AI infrastructureClear filters

109. Design an Embedding Generation and Indexing Pipeline
Embed a billion chunks on GPUs, keep a k-NN index fresh through CDC with versioned writes and provable deletes, and migrate models blue-green.
ClassicMedium
Search AI infrastructure AWS
+4
Batch inference Embeddings Retrieval Vector search
Worked design
Practice
114. Design a Web-Scale Training Data Pipeline
Petabytes of crawled pages into trillions of clean, deduplicated, tokenized and versioned training tokens, with opt-outs honoured.
ClassicMedium
Generative AI AI infrastructure AWS
+3
Data pipeline Deduplication LLMs
Worked design
Practice
129. Design an Image-Text Training Data Pipeline
Billions of image-text pairs from Common Crawl: polite fetching, CLIP scoring, dedup, recaptioning, WebDataset shards and takedowns.
ClassicMedium
AI infrastructure AWS Computer vision
+2
Data pipeline Multimodal
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.