System Design AI

Guided practice

Start with a template. Work through each step. Ask Coach when you need a second opinion.

All designs 2

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

Data pipelineClear filters

114. Design a Web-Scale Training Data Pipeline
Petabytes of crawled pages into trillions of clean, deduplicated, tokenized and versioned training tokens, with opt-outs honoured.
ClassicMedium
Generative AI AI infrastructure AWS
+3
Data pipeline Deduplication LLMs
Worked design
Practice
129. Design an Image-Text Training Data Pipeline
Billions of image-text pairs from Common Crawl: polite fetching, CLIP scoring, dedup, recaptioning, WebDataset shards and takedowns.
ClassicMedium
AI infrastructure AWS Computer vision
+2
Data pipeline Multimodal
Worked design
Practice

Self-paced by default. Your answers and canvas stay private. AI feedback runs only when you ask for it.