Grammar-conditioned sparse LM-head projection for exact structured LLM decoding; Triton runtime, raw evidence, and reproducible Qwen3.5-2B benchmarks.
benchmarking triton json-decoding inference-optimization research-software ml-systems constrained-decoding llm-inference structured-generation xgrammar grammar-constrained-decoding sparse-projection
-
Updated
Sep 29, 2026 - Python