Pause
Reset
init
launch
ready
route
crash
Dockerfile
Build Time
• Model weights baked
• Secret used in build
src/server_launcher.py
Container Start
• Python handler
• rvllm serve subproc
src/handler.py
Health Gate
• Poll /health
• Wait for green
src/request_mapping.py
Request Norm
• Split messages/prompt
• Rewrite model name
src/proxy.py
Proxy & Stream
• Local OpenAI endpoint
• SSE chunks to caller
system
Failure Path
• CUDA error detected
• Exit & container recycle