Skip to content
#

flash-next

Star

Here are 2 public repositories matching this topic...

youssofal / MTPLX

Star 2.5k

The fastest way to run Qwen 3.8 Flash Next, Qwen 3.8 27B and Ternary Bonsai 2 27B on a Mac: 125 tok/s in OpenCode on an M5 Max, and a 27B model on 16 GB Macs. Native MTP speculative decoding on Apple Silicon, exact at any temperature. OpenAI and Anthropic compatible local server.

macos metal mtp mlx inference-engine apple-silicon local-llm llm-inference local-ai qwen speculative-decoding openai-compatible claude-code qwen3-next anthropic-compatible native-mtp mtplx qwen3-8 qwen3-8-flash-next flash-next
  • Updated Sep 26, 2026
  • Python

lifeidle / qwen3.8-flash-next-strata-5090-laptop-24gb

Star 13

Qwen3.8-Flash-Next 177B MoE on RTX 5090 Laptop (24GB VRAM + 64GB RAM): llama.cpp 22-25 tok/s -> Strata 93.5 tok/s (3.7x), GPU+CPU both saturated. 7 quant tiers screened over 26 rounds, MTP corruption found & fixed, 256K context + vision. 中英双语实测实录

moe strata quantization mtp vision-language-model llama-cpp local-llm gguf speculative-decoding rtx5090 qwen3 qwen38 256k-context flash-next
  • Updated Oct 1, 2026
  • Python

Add this topic to your repo

To associate your repository with the flash-next topic, visit your repo's landing page and select "manage topics."

Learn more