42. Design a Metrics Monitoring Platform
Collect 5 million samples a second from 500,000 hosts, store them as time series, chart them and page people.
ClassicMedium
Pick a system. Work through the problem. Compare your approach.
Company tags are community-reported. Counts on cards show how many people reported that design.
Collect 5 million samples a second from 500,000 hosts, store them as time series, chart them and page people.
A live TV vote at a million writes a second: spread by key, buffer in Kafka, aggregate the hot counter in two stages, shed what can wait.
Ten terabytes of logs an hour from host agents through Kafka into tiered OpenSearch and S3, with regex search, live tail and exceptions grouped into issues.