Typed Decision Pipeline
Single Request
Prefix Cache
Route: EN
Route: Multi
Pause
Reset
Pipeline Stage:
1 / 7
Stage 1: Input Request
L1: Input
L2: Cache
L3: Prep
L4: Encoder
L5: Router
L6: Heads
L7: Output
BYPASS
EN
MULTI
INPUT REQUEST
q: "Select Action"
actions: [A, B, C]
state: {context}
PREFIX CACHE
Prompt Hash KV
[OPTIONAL]
TOKEN & PINS
| tok1 | tok2📍 | tok3 |
Marker Injection
BI-ENCODER
<== BERT / LLM ==>
Full Context
SCRIPT ROUTER
Unicode Detect
Route: EN
CHOICE HEAD
Argmax P(A|X)
SCORE HEAD
Conf Logits [0..1]
BOOL HEAD
Binary Flag
TYPED OUTPUT
{"action": "A",
"score": 0.94,
"valid": true}
Stage 1: Input Request
Raw input payload contains prompt question, set of candidate actions, and optional system state.