Designs

Company tags are community-reported. Counts on cards show how many people reported that design.

• 

  2. Design a Distributed Rate Limiter

  Enforce tenant quotas across servers while making burst behavior and outage policy explicit.

  ClassicMedium

  CachingDatabasesConcurrency

  +8

  Distributed systemsAPI gatewaysAWSLuaRate limitingRedisReliabilityToken bucket

  Worked design

  Practice
• 

  10. Design an API Gateway

  Route API traffic with authentication, tenant limits and safe configuration rollout.

  ClassicMedium

  SecurityAPI designAPI gateways

  +7

  AuthenticationAWSControl planeEnvoyRate limitingReliabilityRouting

  Worked design

  Practice
• 

  118. Design an LLM Gateway

  One API in front of every model: token quotas, routing and fallbacks, caching, cost attribution, masked logs and guardrails, streamed without buffering.

  ClassicMedium

  Generative AIAI infrastructureAWS

  +3

  GatewayLLMsRate limiting

  Worked design

  Practice

Each design brings together the brief, practice, examples and discussion.