Speculative Decoding Pipeline

01 / DATA PREP RAW TEXT TARGET MODEL STATE CACHE 02 / DRAFT TRAINING VANILLA MARKOV GATED MARKOV HEAD RNN HEAD CACHE DATASET DRAFT HEAD MOTIF xₜ xₜ₊₁ DRAFT MODEL 03 / EVALUATION DRAFT PREDS TARGET VALIDATOR METRICS ACC RATE: 78% TAU_G: 1.2X TAU_P: 1.5X FORWARD EXTRACT LOAD TRAIN GENERATE VERIFY WEIGHT SHARING