MLSys / inference systems. Quantization, KV memory, scheduling, kernels, speculative decoding.
Every number ships with a committed receipt — not a screenshot.
Portfolio · Receipt console · sdecode session app
| # | System | Receipt-backed result |
|---|---|---|
| 01 | sdecode · receipt | 2.52× tokens per target call, token-identical to naive. Fixed K=8 on GPT-2; the adaptive-K negative result stays in the receipt. |
| 02 | pagemem · receipt | 204 blocks vs 504 for a prefix-shared KV pool — 59.5% fewer blocks, prefix hit rate 1.0. |
| 03 | cplan · receipt | 94% lower TTFT at 1.5 req/s: 34.7 ms continuous vs 565.5 ms static, p99 in the same receipt. |
| 04 | softfp8 · receipt | 2.0× fewer weight bytes with 4.87% relative output error; software FP8 GEMV for non-FP8 GPUs. |
| 05 | latq · receipt | 15.8× compression at 0.607 relative error; D8/D4/Z2 lattice ladder down to 1 bit per weight. |
| 06 | fusednorm · receipt | 33% less norm-site traffic; 1 MiB saved per LLaMA-3 8B decode token. RMSNorm, residual, and SwiGLU epilogue in one pass. |
| 07 | kvstamp · receipt | 8.0× KV compression at 1.14 relative error; token-importance eviction swept to the error knee. |
| 08 | roofline-planner · receipt | 34 deployment plans across 5 models × 9 GPUs: fit check, roofline regime, decode throughput. |
| 09 | gembench · receipt | 1.8× GEMV throughput on CPU: 119.24 ms naive rows → 64.72 ms torch.mv. |
| 10 | bithash · receipt | 3.98× compression at 4.02 effective bits per weight; uniform16 beats odd16 on dense rows. |
- A real measurement first. CPU timings, Triton interpreter parity, real HF weights. GPU figures are labelled models, never borrowed numbers.
- A harness you can run. CLI, test, or live app — then a receipt generated by executing it. The featured sdecode session app is live on the site.
- Tests defend the claim. Assertions live next to the number; CI fails when a receipt drifts.
The portfolio page is generated by src/build.py from the committed receipts. Change a number in a repo, rebuild, and the page changes with it.
- dastanzar.github.io — the three featured case files and the full shipping index.
- Receipt console — the actual JSON behind every headline number.
- sdecode session app — playback of the measured real run, token-for-token.
Open to MLSys / inference engineering roles. Bring me the p99.
© 2026 Abhinav Chauhan · Built from receipts, not screenshots.