System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

Designs with worked examples 4

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

Rate limitingClear filters

2. Design a Distributed Rate Limiter
Enforce tenant quotas across servers while making burst behavior and outage policy explicit.
ClassicMedium
Caching Databases Concurrency
+8
Distributed systems API gateways AWS Lua Rate limiting Redis Reliability Token bucket
Worked design
Practice
10. Design an API Gateway
Route API traffic with authentication, tenant limits and safe configuration rollout.
ClassicMedium
Security API design API gateways
+7
Authentication AWS Control plane Envoy Rate limiting Reliability Routing
Worked design
Practice
32. Token Bucket Rate Limiter
A limit enforced per server is not a limit: ten servers each allowing a hundred requests a minute allow a thousand. And a counter per fixed window lets twice the limit through across a window boundary.
Infrastructure & SREMedium
Caching Databases Lua
+3
Rate limiting Redis Token bucket
Worked design
Practice
118. Design an LLM Gateway
One API in front of every model: token quotas, routing and fallbacks, caching, cost attribution, masked logs and guardrails, streamed without buffering.
ClassicMedium
Generative AI AI infrastructure AWS
+3
Gateway LLMs Rate limiting
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.