The design library
Building blocks, complete architectures, and variations worth comparing. Search by the problem you want to solve or a component you want to understand.
Classic designOfficial
Ten terabytes of logs an hour from host agents through Kafka into tiered OpenSearch and S3, with regex search, live tail and exceptions grouped into issues: one-hour boards for junior, senior and staff, with the theory behind them.
Classic designOfficial
Count 4 million moving drivers per map cell from a million pings a second, and serve the density to a million viewers as cached map tiles: one-hour boards for junior, senior and staff, with the theory behind them.
Classic designOfficial
Rank 200 million players in real time with sharded Redis sorted sets, count every game exactly once, and close a season fairly: one-hour boards for junior, senior and staff, with the theory behind them.
Classic designOfficial
A stateful stream processor: dataflow graphs, keyed state in RocksDB, event time and watermarks, windows, barrier checkpoints, exactly-once into Kafka: one-hour boards for junior, senior and staff, with the theory behind them.
Classic designOfficial
A live TV vote at a million writes a second: spread by key, buffer in Kafka, aggregate the hot counter in two stages, shed what can wait: one-hour boards for junior, senior and staff, with the theory behind them.
Classic designOfficial
The K most-viewed videos for the last hour, day, month and all time from 700,000 views a second, exactly and in milliseconds: one-hour boards for junior, senior and staff, with the theory behind them.
Classic designOfficial
Count every ad click once, fast enough to chart live and exactly enough to bill. One-hour interview boards for junior, senior and staff: requirements, data layer, low-level design and what goes wrong at every component.