Building blocks, complete architectures, and variations worth comparing. Search by the problem you want to solve or a component you want to understand.
Signed HTTPS callbacks for a billion events a day, at least once, retried for three days, with no endpoint able to slow another: one-hour boards for junior, senior and staff, with the theory behind them.
webhooksinfrastructureat-least-onceretries
System Design AI·Junior → Staff0 bookmarks0 comments
Ten terabytes of logs an hour from host agents through Kafka into tiered OpenSearch and S3, with regex search, live tail and exceptions grouped into issues: one-hour boards for junior, senior and staff, with the theory behind them.
observabilityloggingerror-trackingkafka
System Design AI·Junior → Staff0 bookmarks0 comments
Count 4 million moving drivers per map cell from a million pings a second, and serve the density to a million viewers as cached map tiles: one-hour boards for junior, senior and staff, with the theory behind them.
geospatialstream-processingflinkkafka
System Design AI·Junior → Staff0 bookmarks0 comments
Rank 200 million players in real time with sharded Redis sorted sets, count every game exactly once, and close a season fairly: one-hour boards for junior, senior and staff, with the theory behind them.
gamingleaderboardredissorted-sets
System Design AI·Junior → Staff0 bookmarks0 comments
Dish reviews only from customers who ordered them, votes counted from a change stream, reviews ranked by the Wilson bound, payouts made exactly once: one-hour boards for junior, senior and staff, with the theory behind them.
socialreviewsratingsranking
System Design AI·Junior → Staff0 bookmarks0 comments
Push, email, SMS and in-app for a billion deliveries a day: priorities that never wait, promotions that never arrive late, no duplicates a user would notice. One-hour boards for junior, senior and staff, with the theory behind them.
notificationsreal-timefan-outkafka
System Design AI·Junior → Staff0 bookmarks0 comments
Every committed change in Aurora and DynamoDB, read from the log and delivered in order per row to search, caches, Redshift and an S3 lake: one-hour boards for junior, senior and staff, with the theory behind them.
advanced-topiccdcdebeziumkafka
System Design AI·Junior → Staff0 bookmarks0 comments
A stateful stream processor: dataflow graphs, keyed state in RocksDB, event time and watermarks, windows, barrier checkpoints, exactly-once into Kafka: one-hour boards for junior, senior and staff, with the theory behind them.
flinkkey-technologystream-processingexactly-once
System Design AI·Junior → Staff0 bookmarks0 comments
A partitioned, replicated append-only log: a million messages a second, order per key, nothing acknowledged ever lost, a week of replayable history: one-hour boards for junior, senior and staff, with the theory behind them.
kafkakey-technologydistributed-logreplication
System Design AI·Junior → Staff0 bookmarks0 comments
A live TV vote at a million writes a second: spread by key, buffer in Kafka, aggregate the hot counter in two stages, shed what can wait: one-hour boards for junior, senior and staff, with the theory behind them.
patternscaling-writesshardingkafka
System Design AI·Junior → Staff0 bookmarks0 comments
Search a billion posts a day by keyword, newest or most liked first, with an inverted index you build yourself: one-hour boards for junior, senior and staff, with the theory behind them.
searchinverted-indexkafkaredis
System Design AI·Junior → Staff0 bookmarks0 comments
A home feed for 2 billion users: fan-out on read, on write, and the hybrid for huge accounts, with precomputed feeds, cursors and hot posts: one-hour boards for junior, senior and staff, with the theory behind them.
news-feedfan-outtimelineredis
System Design AI·Junior → Staff0 bookmarks0 comments
Charge cards through the networks exactly once: idempotency keys, a card vault, timeouts as unknowns, signed webhooks, a double-entry ledger and reconciliation. One-hour boards for junior, senior and staff, with the theory behind them.
paymentsidempotencyledgerreconciliation
System Design AI·Junior → Staff0 bookmarks0 comments
Take bids on 10 million live auctions with one consistent highest bid, lose none, push the price to every watcher and end each auction fairly: one-hour boards for junior, senior and staff, with the theory behind them.
auctionscontentionkafkaserver-sent-events
System Design AI·Junior → Staff0 bookmarks0 comments
Watch prices on 500 million products with a polite crawler and a million browsers, verify what you are told, and notify subscribers within minutes of a drop: one-hour boards for junior, senior and staff, with the theory behind them.
crawlingkafkadynamodbnotifications
System Design AI·Junior → Staff0 bookmarks0 comments
The K most-viewed videos for the last hour, day, month and all time from 700,000 views a second, exactly and in milliseconds: one-hour boards for junior, senior and staff, with the theory behind them.
top-kstream-processingkafkaflink
System Design AI·Junior → Staff0 bookmarks0 comments
Collect 5 million samples a second from 500,000 hosts, store them as time series, chart them and page people: one-hour boards for junior, senior and staff, with the theory behind them.
time-serieskafkaprometheusalerting
System Design AI·Junior → Staff0 bookmarks0 comments
Count every ad click once, fast enough to chart live and exactly enough to bill. One-hour interview boards for junior, senior and staff: requirements, data layer, low-level design and what goes wrong at every component.
stream-processingkafkaflinkdynamodb
System Design AI·Junior → Staff0 bookmarks0 comments