Flash-MoE: The Apple Silicon Engine That Makes a 397B Model Behave Like It Has More Memory
A pure C and Metal inference stack for Apple Silicon that streams MoE experts from SSD, leans on macOS page cache instead of custom caching, and turns hardware constraints into the architecture.
9 min read ยท Mar 24, 2026