Designs

Company tags are community-reported. Counts on cards show how many people reported that design.

• 

  44. Design a Price Tracking Service

  Watch prices on 500 million products with a polite crawler and a million browsers, verify what you are told, and notify subscribers within minutes of a drop.

  ClassicMedium

  DatabasesStreamingDistributed systems

  +6

  AWSCrawlingCrowdsourcingDynamoDBKafkaNotifications

  Worked design

  Practice
• 

  46. Design a Web Crawler

  Ten billion pages in five days, politely, without losing progress: fetchers and parsers, domain locks, bandwidth math, deduplication and a crawl that stays fresh. One-hour boards for junior, senior and staff.

  ClassicMedium

  QueuesObject storageAWS

  +5

  CrawlingDeduplicationPolitenessAmazon S3Amazon SQS

  Worked design

  Practice

Each design brings together the brief, practice, examples and discussion.