A from-scratch Zig inference engine for large MoE models - stream experts from SSD → RAM → VRAM and keep the resident working set small. ColiZig explores a different way to run Mixture-of-Experts models: instead of loading the entire model into memory, it treats expert weights as a tiered working set and streams them between SSD, RAM and opt. VRAM
4 stars
Zig
Your first custom repo explanation is free. Reading existing public explainers always stays free.
This will take 10-20 minutes. You can close the tab and come back later.