Local LLM Inferenceesp32-ai: The LLM That Treats Flash Like Memory
How slvDev/esp32-ai runs a 28.9M-parameter language model on an ESP32-S3 by splitting weights across SRAM, PSRAM, and Flash, then reading only what each token actually needs.
9 min read ยท Jul 27, 2026