System Design AI

Guided practice

Start with a template. Work through each step. Ask Coach when you need a second opinion.

Designs with worked examples 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

StreamingClear filters

106. Design an LLM Chat Assistant like ChatGPT
A chat assistant on models we train and serve: next-token framing, three training stages, resumable SSE streams, prefix caching, token quotas, safety, evaluation.
ClassicMedium
Streaming Machine learning Generative AI
+2
AWS LLMs
Worked design
Practice

Self-paced by default. Your answers and canvas stay private. AI feedback runs only when you ask for it.