Skip to content

test(claw): kill mutation-sweep survivors in evidence, gates, preview, engine - #10674

Merged
gHashTag merged 1 commit into
masterfrom
claw-mutation-sweep
Oct 18, 2026
Merged

gHashTag merged 1 commit into
masterfrom
claw-mutation-sweep

Conversation

@gHashTag

Copy link
Copy Markdown
Owner

What

A mutation sweep (the operator set cargo-mutants, PIT and Stryker apply by default) ran over ten TRI CLAW specs that had no mutation record. This PR adds tests that kill every surviving mutant a test can observe in four of them: evidence, gates, preview and engine. The issue (#10673) has the full per-spec table.

Spec Tests before Tests after New things pinned
evidence.t27 12 16 seal_ok refuses an uppercase digit, a byte past f and sha512:; one past each code table is refused; span_ok at line 1..1; a refused row is counted once
gates.t27 18 20 the audit's tail line (current vs DRIFT); each coverage report line in full, with its three examples
preview.t27 18 19 a suffix equal to the string; a needle as long as the hay; an env name with the right digits under another prefix; a URL with no sha=
engine.t27 16 16 an empty draft_path is refused, added to the existing handoff test

Verification (Railway lab)

  • t27c test-report: 71 tests pass (evidence 16, engine 16, preview 19, gates 20), 0 vacuous passes.
  • t27b test: the same 71 tests pass.
  • The 39 code-line survivors in these four specs were re-run one at a time: 20 are now caught. The other 19 cannot be observed:
    • evidence 167: a compose_label tie gives the same label either way.
    • preview 152 is an empty line. Preview 244, 245 and 247 (< 0 to <= 0): find_from starts at PAGE.len, so 0 never occurs.
    • engine 86 and 158: the a < 1 clamp. Engine 89: the clamp at RD_OWNER. Engine 97: the MAX_ROUNDS boundary gives 0 either way.
    • gates 155, 156, 164 and 176: guards over fixed tables that never reach the bound.
    • gates 224, 248, 285 and 291: the extra loop pass is a no-op or is overwritten. Gates 292: the out_cap bound is not observable at these sizes.
  • seal --save for the four specs, then seal --verify: all 31 claw seals match.
  • gen-c for gates compiles with gcc.

Closes #10673

🤖 Generated with Claude Code

…, engine

A cargo-mutants/PIT-style operator sweep over ten claw specs left 39
survivors on code lines of these four. New tests catch 20; the other 19
are equivalent (listed in the PR). seal_ok now has a test for an
uppercase digit, a byte past f and another algorithm; gates pins the
audit tail line and each coverage report line in full.

Closes #10673

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
@gHashTag
gHashTag enabled auto-merge (squash) October 18, 2026 21:40
@github-actions

Copy link
Copy Markdown
Contributor

PR Dashboard

Generated at: 2026-10-18 21:40:28 UTC

Summary

Status Count
Total Open PRs 50
PRs with Failing Checks 48
PRs with All Checks Green 2
READY 2
FAILING 48
PENDING 0
NO CHECKS YET 0

Seal Status

  • ⚠️ STALE -- sha256(compiler.rs)=fad12492937a != manifest seal=87e5cbd3ad94.
    The committed NMSE numbers were certified against an older compiler.rs.
    Run scripts/reseal-check.sh locally for the two-step reseal command (advisory; not a merge gate).

@gHashTag
gHashTag merged commit d8ef9cc into master Oct 18, 2026
33 of 37 checks passed
gHashTag added a commit that referenced this pull request Oct 18, 2026
…0547, Refs #10674)

#10674 added two tests to specs/claw/gates.t27 without regenerating the
committed C, so spec-guards' freshness step fails on master and on every
branch that merged it. Output of t27c gen-c on the Railway lab (ig3
91c9193); the hunks match the ones spec-guards printed.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
gHashTag added a commit that referenced this pull request Oct 18, 2026
…loses #10683)

spec-guards has been red on master since d8ef9cc: two tests were added
to the spec, but the committed C was not regenerated. This is t27c gen-c
output from the Railway lab on master 40b59d3. All 20 tests pass under
-DT27_TEST_MAIN.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
gHashTag added a commit that referenced this pull request Oct 18, 2026
…loses #10683) (#10684)

spec-guards has been red on master since d8ef9cc: two tests were added
to the spec, but the committed C was not regenerated. This is t27c gen-c
output from the Railway lab on master 40b59d3. All 20 tests pass under
-DT27_TEST_MAIN.

Co-authored-by: Claude Opus 5.5 <noreply@anthropic.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

claw: mutation sweep -- 20 of 31 TRI CLAW specs had no mutation record; real gaps in evidence, gates, preview, engine

1 participant