System Design AI

Guided practice

Start with a template. Work through each step. Ask Coach when you need a second opinion.

Designs with worked examples 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

GatewayClear filters

118. Design an LLM Gateway
One API in front of every model: token quotas, routing and fallbacks, caching, cost attribution, masked logs and guardrails, streamed without buffering.
ClassicMedium
Generative AI AI infrastructure AWS
+3
Gateway LLMs Rate limiting
Worked design
Practice

Self-paced by default. Your answers and canvas stay private. AI feedback runs only when you ask for it.