Reset
Pause
Generate Token
STATELESS PYTORCH
OPTIMUM STATEFUL
Python Boundary
C++ / OpenVINO Boundary
HEAVY KV
HEAVY KV
Generate Loop
KV Tensors (Py)
C++ Forward Pass
TOKEN
LOCKED KV
Generate Loop
OpenVINO Engine
KV State