Skip to content

cuda+server: q8_0 K/V at the full 262k window on 12 GB (tiered VMM KV cache), MTP drafting at every depth - #285

Closed
professorpalmer wants to merge 6 commits into
PrismML-Eng:prismfrom
professorpalmer:claude/q8-262k-tier
Closed

cuda+server: q8_0 K/V at the full 262k window on 12 GB (tiered VMM KV cache), MTP drafting at every depth#285
professorpalmer wants to merge 6 commits into
PrismML-Eng:prismfrom
professorpalmer:claude/q8-262k-tier

Commits

  1. Commits on Sep 29, 2026