Skip to content

Check that each Scorecard run reached scorecard.dev - #38

Merged
askalf merged 1 commit into
mainfrom
claude/nifty-bell-1lpk8e
Nov 10, 2026
Merged

askalf merged 1 commit into
mainfrom
claude/nifty-bell-1lpk8e

Conversation

@askalf

@askalf askalf commented Nov 10, 2026 •

Copy link
Copy Markdown
Owner

What and why

scorecard-action reports a failed publish to scorecard.dev as a warning, and the run stays green. On 2026-11-09 that happened to askalf/pitlane: its publish was answered 500, scorecard.dev served "not found" for the repository for about fifteen hours, and the README badge read "invalid repo path" with no run red. This repository shows the same badge and publishes the same way.

This adds .github/workflows/scorecard-publish.yml, the caller askalf/ci's README gives for its scorecard-publish-check action (askalf/ci#199). On workflow_run of Scorecard, for a run that succeeded on the default branch, the action reads what scorecard.dev serves for the repository. If the run's result is not there it dispatches Scorecard once more; if the unpublished run was itself a dispatch, the job fails. It is a workflow of its own because scorecard.dev accepts results only from a job whose steps it recognises.

The job runs on a GitHub-hosted runner with actions: write and no other permission, and checks out nothing. The action is pinned at the commit that added it; the pin bump moves it with the other askalf/ci pins.

It ran for the first time on askalf/ci's main on 2026-11-10 after askalf/ci#200: it read the run from the event and reported published: scorecard.dev serves a result dated 2026-11-10T03:17:46Z for askalf/ci; run 42748482341 started 2026-11-10T03:17:37Z. The retry path has not run for real, since no publish has failed since.

Checks

  • npm test passes (268 pass, 0 fail)
  • npm run build run and dist/ committed (not needed: no source file changes)
  • A new or changed rule has a fixture it must catch, a near miss it must leave alone, and an entry in docs/rules.md (no rule changes)
  • Fixtures are synthetic (no other project's run data) (none added)

scorecard-action reports a failed publish as a warning on a green run. On
2026-11-09 a publish from askalf/pitlane was answered 500, scorecard.dev
served "not found" for the repository for fifteen hours, and the README
badge read "invalid repo path" with no run red.

scorecard-publish.yml runs askalf/ci's scorecard-publish-check action on
workflow_run of the Scorecard workflow: a successful run whose result is
not at scorecard.dev gets one more dispatch, and a dispatch that is
unpublished too fails the job.
@askalf
askalf marked this pull request as ready for review November 10, 2026 03:23
@askalf
askalf enabled auto-merge (squash) November 10, 2026 03:25

@sprayberry-redline sprayberry-redline left a comment

Copy link
Copy Markdown
Collaborator

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Verdict: approve. The new workflow targets completion of the existing Scorecard workflow and limits execution to successful runs in public repositories. The action is pinned to a commit, runs without a checkout, and receives only the actions permission needed for a retry dispatch.

@askalf
askalf merged commit 05ba2b1 into main Nov 10, 2026
11 checks passed
@askalf
askalf deleted the claude/nifty-bell-1lpk8e branch November 10, 2026 03:32
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants