AIFIRST Benchmarking DFlash 2 in llama.cpp on Qwen 3.8 27B against all speculative methods
The brief
A developer ran a 3-day benchmark of Inco AI's DFlash 2 speculative decoding PR in llama.cpp against plain decoding, MTP, n-gram lookup drafters, and the previous DFlash 1 on Qwen 3.8 27B.
Key points
- DFlash 2 introduces a trained drafter specifically for Qwen 3.8 27B and shows meaningful throughput improvements over all comparison methods.
Sources
- redditreddit.com