One Prefix, Many Decisions
Interactive Architecture Demonstration: KV Cache Fan-out
OpenJev Path
Naive Path
Pause
Reset
Execution Architecture
Shared Prefill (1 Pass)
Prefill Forward Passes
1 Pass
Redundant Compute Saved
75%
Throughput Multiplier
3.8x
01 / Input Stage
02 / Context Cache
03 / Branch Decisions
1x
FILL
ZERO-COPY
REDUNDANT PREFILL (4x)
SHARED PREFIX
PREFILL STAGE
SHARED KV CACHE
CHOICE A: INTENT
CHOICE B: ROUTE
CHOICE C: YES / NO
CHOICE D: PARAMS
Interactive Diagram Active
Hover or click any node to trace connection paths and examine cache behavior.
Click node to inspect