Skip to content

fix(ci): the corpus ledger says what is true - #5551

Merged
dmitrii-f-t27 merged 1 commit into
masterfrom
fix/corpus-ledger-hygiene
Oct 2, 2026
Merged

dmitrii-f-t27 merged 1 commit into
masterfrom
fix/corpus-ledger-hygiene

Conversation

@dmitrii-f-t27

Copy link
Copy Markdown
Collaborator

What

The last step of Corpus Ratchet, t27c suite --ratchet --corpus-only, had not been reached on CI since the earlier steps went red (they are green since #5502 and #5504). On master 769f325 it reports:

ledger 151 / 152 cap, observed 162
UNEXPECTED FAILURES 68   UNEXPECTED PASSES 57   DISCARD WORSENED 7   DISCARD IMPROVED 5

Change to docs/reports/suite_expectations.json

change count rule
entries whose spec now passes every phase -51 the ratchet reports each as UNEXPECTED PASS: "fixed -- remove from the ledger"
specs that parse now and fail one phase later 6 re-keyed parse -> verilog-no-keyword-decl / parse-no-discard / typecheck; old reason kept, prefixed with the move
discard pins that improved 5 lowered uart, coder/benchmark, cordic, jit, lotus; no pin rises
failures of ported specs merged while the gate was red +33 under #5549 (ports to be redone), phases parse 15, parse-no-discard 9, gen-verilog 7, typecheck 2
cap max_entries 152 -> 133 follows the count down, as #2909 did, so nothing hides in the slack

_why_entries_fell records the same breakdown.

Not ledgered, on purpose

  • 29 core specs that began discarding tokens after edits since 2026-09-12. Most of the edits are bee commits "Implement ... functions" that put statements inside given/when/then test blocks, so the parser now throws the whole block away (bdd-block-fallback); others leave top-level-resync or brace-body debris.
  • 7 specs whose discard counts rose.

These are repairs, not records; they come in the next PRs. With this ledger the ratchet reports exactly them: 29 unexpected failures, 7 worsened, 0 unexpected passes, 0 expired.

Refs #5497

🤖 Generated with Claude Code

The corpus ratchet had not run on CI since earlier Corpus Ratchet steps went
red. On master 769f325 it reports 68 unexpected failures, 57 unexpected
passes and 7 worsened discard counts, against 151 entries at a cap of 152.

- 51 entries whose specs now pass every phase are removed.
- 6 specs that parse now and fail one phase later are re-keyed to that
  phase, keeping their old reason (composition, multi_head_attn,
  pins/parser, packed_trit, jit_semantics, packed_vsa).
- 5 discard pins that improved move down (uart, coder/benchmark, cordic,
  jit, lotus).
- 33 failures of ported specs merged while the gate was red are added under
  #5549, whose ports are to be redone.

151 -> 133 entries; the cap follows the count down to 133.

Not ledgered, on purpose: 29 core specs that began discarding tokens after
edits since 2026-09-12, and 7 whose discard counts rose. Those are repairs,
not records; the ratchet now reports exactly them.

Refs #5497

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

📓 NotebookLM Notebook linked to this PR

This notebook contains session context, decisions, and artifacts for this work.

@github-actions

github-actions Bot commented Oct 2, 2026

Copy link
Copy Markdown
Contributor

PR Dashboard

Generated at: 2026-10-02 10:22:15 UTC

Summary

Status Count
Total Open PRs 50
PRs with Failing Checks 47
PRs with All Checks Green 3
READY 3
FAILING 47
PENDING 0
NO CHECKS YET 0

Seal Status

  • ⚠️ STALE -- sha256(compiler.rs)=b7d5cc5c4cf1 != manifest seal=87e5cbd3ad94.
    The committed NMSE numbers were certified against an older compiler.rs.
    Run scripts/reseal-check.sh locally for the two-step reseal command (advisory; not a merge gate).

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant