Skip to content

Correction of record: decode depth-regime attribution + prefill band correction - #1

Merged
simongonzalezdc merged 2 commits into
mainfrom
correction/depth-regime-and-prefill-band-20260916
Sep 17, 2026
Merged

simongonzalezdc merged 2 commits into
mainfrom
correction/depth-regime-and-prefill-band-20260916

Conversation

@simongonzalezdc

Copy link
Copy Markdown
Member

Two corrections of record, receipts attached:

  1. Decode depth-regime attribution. The README disclosed a ~2.4x live-vs-ambient decode spread without attributing it. First context-depth receipts on the same hardware (2026-09-16) attribute it: stock unstacked decode falls 11.5 → 10.7 → 8.5 t/s at depth-0/8K/32K (−26%), while the resident production stack rises with depth (28.49 @131k, 28.43 @262K — n-gram speculative acceptance grows with context). Decode figures now carry regime labels going forward.

  2. Prefill band correction. Current salted-protocol band on this box: 318-330 / 300-312 / 271-280 t/s @8/16/32K. The 2026-08-30 figures (215/207/184) understated prefill under the earlier unsalted protocol. Original receipts retained verbatim; this is the correction of record.

Original measurements are preserved unchanged; both corrections are additive annotations in the claim-boundary section.

…plained; first depth receipts) + prefill band correction (salted protocol 318-330/300-312/271-280 vs understated 215/207/184)
@simongonzalezdc
simongonzalezdc merged commit 276990e into main Sep 17, 2026
8 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant