Classic design · Junior → Staff · by System Design AI

Design a Speculative Decoding Service

A cheap drafter guesses several tokens and a self-hosted 70B checks them in one pass, with rejection sampling keeping its output distribution exact: one-hour boards for junior, senior and staff, with the theory behind them.