Betelgeuse running Qwen 3.8 Flash Next IQ4_XS at 24 tok/s on 2x8GB DDR4 (14 tok/s on a single 16GB stick) + RTX 3060 12GB — 0 dropped experts, 100% byte-exact
Reddit r/LocalLLaMA1d4 min read
In my last thread on Betelgeuse ( bel-cli / bel-server ), the main pushback in the comments was: "Okay cool, 22 tok/s on IQ2_XS , but 2-bit is too low—what happens on an actual 4-bit quant like IQ4_XS where the experts are almost 2x larger?" "Why were you testing on a single 16GB stick of DDR4 instead of normal dual-channel 2x 8GB ?" Fair questions. So I upgraded the oracle + victim-cache DMA path, packed IQ4_XS (~100GB+ class, full 4-bit experts), and tested it on the exact same RTX 3060 12GB under both RAM configs (still 16GB total system RAM in both tests): Config A: 1x 16GB DDR4 (single-ch