Skip to content

ci(gate): don't fail the check when a fork PR can't be commented on - #172

Merged
patsypppe merged 1 commit into
mainfrom
fix/gate-comment-on-forks
Nov 8, 2026
Merged

patsypppe merged 1 commit into
mainfrom
fix/gate-comment-on-forks

Conversation

@patsypppe

Copy link
Copy Markdown
Owner

What this changes

The gate workflow's Comment step fails on pull requests from forks, because GitHub gives them a read-only token (Resource not accessible by integration). The gate itself passed, but the check showed red. This happened on #170.

  • The Comment step now runs only when the PR is from this repository.
  • A new Job summary step always writes the verdict to the run's summary, so fork PRs still get a readable result.

How it was checked

  • The workflow file parses as valid YAML.
  • Not exercised end to end here: it needs a fork PR to prove it. The next outside PR's gate check is the test.

Generated by Claude Code

A pull request from a fork gets a read-only token, so the Comment step
failed with 'Resource not accessible by integration' and turned a passing
gate red (seen on #170, where the verdict was pass). Skip the comment for
forks and always write the verdict to the job summary instead.

Co-Authored-By: Claude Sonnet 5.5 <noreply@anthropic.com>
Claude-Session: https://claude.ai/code/session_017urKavHf7CSyMqnzeCCyoy
@github-actions

github-actions Bot commented Nov 8, 2026

Copy link
Copy Markdown

Meridian gate

✅ PASS — suite pass^k moved -0.000 (0.486 → 0.486), within the 0.030 tolerance

Failing trials in this run
  • expired-coupon — SELECT status FROM orders WHERE id = 1042 returned [['pending']], expected [['invoiced']]
  • expired-on-bulk-order — SELECT status FROM orders WHERE id = 1045 returned [['pending']], expected [['invoiced']]
  • expiry-boundary — SELECT status FROM orders WHERE id = 1046 returned [['pending']], expected [['invoiced']]
  • happy-path — SELECT status FROM orders WHERE id = 1041 returned [['pending']], expected [['invoiced']]
  • stale-coupon — SELECT status FROM orders WHERE id = 1044 returned [['pending']], expected [['invoiced']]
  • unknown-coupon — SELECT status FROM orders WHERE id = 1047 returned [['pending']], expected [['invoiced']]
task baseline pass^3 head pass^3
expired-coupon 0.400 0.400
expired-on-bulk-order 0.400 0.400
expiry-boundary 0.400 0.400
happy-path 0.400 0.400
missing-field 1.000 1.000
stale-coupon 0.400 0.400
unknown-coupon 0.400 0.400
baseline head
suite pass^3 0.486 0.486

Sensitivity. Not estimated: all 7 tasks moved by the same amount, so there is no spread to estimate sensitivity from. Treat the verdict as directional.

n=5 · k=3 · status complete · harness errors 0.0% · cost 51c

head run run-1794154261-314b63 · baseline run run-1794154220-a2ac0c · manifest sha256:dc5d8b9aea937606… · reproduce with meridian replay run-1794154261-314b63

@patsypppe
patsypppe merged commit ba70af6 into main Nov 8, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants