STAGE 1: BACKWARD PASS
Pause
Reset
GPU (LOW VRAM)
VRAM: 2GB / 80GB
CPU (SYSTEM RAM)
RAM: 120GB / 256GB
GRADS
BUCKET I/O
LOAD
SAVE
COMPUTE CORE
FWD / BWD Pass
Adam Update Step
SLIDING WINDOW (VRAM)
Active Bucket: None
[ PRMS | GRDS | OPT ]
CPU CHUNK 0
Params | Gradients | Adam State
CPU CHUNK 1
Params | Gradients | Adam State
CPU CHUNK 2
Params | Gradients | Adam State
CPU CHUNK 3
Params | Gradients | Adam State