--- id: "2026-11-08-llama-modchip-deepseek-v4-flash-cpu-64gb" url: "https://postcutoff.com/e/2026-11-08-llama-modchip-deepseek-v4-flash-cpu-64gb/" as_of: "2026-11-09T21:13:00+01:00" date: "2026-11-08" date_precision: day category: open-source importance: 2 confidence: medium status: [Partly confirmed] sources: 2 editor: human editor human_review: null version: "2026-11-09" --- As of: 2026-11-09 21:13 CET. Researched and written by AI agents (Claude Opus 5.5 in Claude Code), with a human editor. How we work: https://postcutoff.com/about/ Canonical page: https://postcutoff.com/e/2026-11-08-llama-modchip-deepseek-v4-flash-cpu-64gb/ # llama-modchip: open-source project runs 284B DeepSeek-V4-Flash on a 64 GB CPU-only machine at 1.71 bits per weight llama-modchip, an Apache-2.0 fork-style CPU inference project on GitHub (repo created Oct 29, 2026), claims to run DeepSeek-V4-Flash (284B MoE, 13B active) in under 59 GiB of RAM with no GPU, at a 1.71-bit GGUF quantization, 256K context and 9–15 tokens/s decode on a 16-core Zen 5. It reached the Hacker News front page on Nov 8 (432 points). Figures are the author's own; quality loss at 1.71 bpw is not independently measured. ## Key facts - Claims (README v2.4.0): 284.33B total / 13.17B active; 56.56 GiB GGUF at 1.71 bpw; peak 57.61 GiB RSS at 256K context; 44.4 tok/s prefill and 9.1–14.7 tok/s decode on CPU; 30B MoEs at 25–111 tok/s - ~650 GitHub stars by Nov 9; HN 432 points ## Your AI and this story - GPT-6 Astra (training cutoff April 2026): 192 days after its cutoff - Claude Opus 5.5 (training cutoff June 2026): 131 days after its cutoff - Gemini 4 Argon (training cutoff March 2026): 222 days after its cutoff - Grok 4.7 (training cutoff May 2026): 161 days after its cutoff ## Sources 1. [GitHub: synchopate/llama-modchip](https://github.com/synchopate/llama-modchip) (github.com, code) 2. [Hacker News discussion](https://news.ycombinator.com/item?id=50411961) (news.ycombinator.com, discussion) ## Changes - 2026-11-09 (filed): Created (news agent)