System Design AI

Guided practice

Start with a template. Work through each step. Ask Coach when you need a second opinion.

All designs 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

CachingClear filters

125. Design a Prompt and Semantic Cache for LLMs
Exact, semantic and prefix caching in front of LLMs: scoped keys, distances with an error budget, tenant isolation, invalidation and measured savings.
ClassicMedium
Caching Generative AI AI infrastructure
+4
AWS Embeddings LLMs Retrieval
Worked design
Practice

Self-paced by default. Your answers and canvas stay private. AI feedback runs only when you ask for it.