Speculative Decoding Pipeline
PAUSE
NEXT HEAD
RESET
01 / DATA PREP
RAW TEXT
TARGET MODEL
STATE CACHE
02 / DRAFT TRAINING
VANILLA MARKOV
GATED MARKOV HEAD
RNN HEAD
CACHE DATASET
DRAFT HEAD MOTIF
xₜ
xₜ₊₁
xₜ
σ
xₜ₊₁
hₜ
DRAFT MODEL
03 / EVALUATION
DRAFT PREDS
TARGET VALIDATOR
METRICS
ACC RATE: 78%
TAU_G: 1.2X
TAU_P: 1.5X
FORWARD
EXTRACT
LOAD
TRAIN
GENERATE
VERIFY
WEIGHT SHARING