Pause
Reset
Client Layer
Router Layer
Provider Layer
MODEL_NAME
vllm_api_base
openrouter_key
anthropic_key
REQ
deepseek-math
RUNTIME_PROVIDER
Resolves endpoints
Injects API Keys
Handles fallbacks
LOCAL VLLM
Self-hosted inference
OPENROUTER
Aggregated API
ANTHROPIC
Native Claude API