VRAM Constraints
Available VRAM: 140GB
Pause
Reset
FP16 (140GB)
Q8 FILTER (80GB)
Q6 FILTER (60GB)
Q4 FILTER (40GB)
Q2 FILTER (20GB)
INFERENCE
DATA FLOW
70B MODEL