System Design AI

Designs

Pick a system. Work through the problem. Compare your approach.

Create your own

Designs with worked examples 1

Ordered by design number

Company tags are community-reported. Counts on cards show how many people reported that design.

InferenceClear filters

127. Design a Model Quantization and Compression Pipeline
Every new LLM version shrunk to FP8, INT8 or INT4 with a smaller KV cache, gated against its BF16 parent and benchmarked on the serving GPU.
ClassicMedium
Machine learning Generative AI AWS
+3
Inference LLMs Quantization
Worked design
Practice

Each design brings together the brief, practice, examples and discussion.