Pause
Mode: Decoupled
Reset
Training Engine
Shared Infrastructure
Inference Engine
EXPERIENCE
PROMPTS
ROLLOUTS
WEIGHT UPDATE (P2P)
SWAP OUT
SWAP IN
MEGATRON-LM
DATA BUFFER
SGLANG WORKERS
CPU MEMORY