Skip to content

Fix AWF checksum failure in flaky-test workflow - #8792

Closed
joshblack wants to merge 2 commits into
mainfrom
copilot/fix-flaky-tests-on-main
Closed

joshblack wants to merge 2 commits into
mainfrom
copilot/fix-flaky-tests-on-main

Conversation

@joshblack

@joshblack joshblack commented Nov 17, 2026 •

Copy link
Copy Markdown
Member

The workflow failed before agent execution because its generated lock requested AWF v0.28.57, which had no reviewed checksum pin. Refresh the lock with gh-aw v1.0.1 to use AWF v0.29.0 and its pinned setup action.

Changelog

New

Changed

  • Regenerate .github/workflows/fix-flaky-tests.lock.yml with updated runtime and container pins.

Removed

Rollout strategy

  • No rollout required — Workflow-only change; no published package behavior or API change.

Testing & Reviewing

Confirm the generated lock uses the reviewed AWF v0.29.0 pin and leaves checksum verification enabled.

@changeset-bot

changeset-bot Bot commented Nov 17, 2026

Copy link
Copy Markdown

⚠️ No Changeset found

Latest commit: ca3cdd3

Merging this PR will not cause a version bump for any packages. If these changes should not result in a new version, you're good to go. If these changes should result in a version bump, you need to add a changeset.

This PR includes no changesets

When changesets are added to this PR, you'll see the packages that this PR includes changesets for and the associated semver types

Click here to learn what changesets are, and how to add one.

Click here if you're a maintainer who wants to add a changeset to this PR

Co-authored-by: copilot-swe-agent[bot] <198982749+Copilot@users.noreply.github.com>
@joshblack joshblack changed the title [WIP] Fix flaky tests on main to prevent failures Fix AWF checksum failure in flaky-test workflow Nov 17, 2026
@joshblack
joshblack marked this pull request as ready for review November 19, 2026 22:00
@joshblack
joshblack requested a review from a team as a code owner November 19, 2026 22:00
@joshblack
joshblack requested review from francinelucca and a balanced review from Copilot November 19, 2026 22:00
@joshblack
joshblack enabled auto-merge November 19, 2026 22:00
@joshblack joshblack added skip changeset This change does not need a changelog integration-tests: skipped manually Changes in this PR do not require an integration test labels Nov 19, 2026

Copilot AI left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

🔵 Needs a closer look

SAML restrictions blocked inspection of the pinned setup action, leaving its reviewed AWF v0.29.0 checksum and regenerated runtime compatibility unverified.

No open issues 🎉

What changed in this PR

Refreshes the generated flaky-test workflow to address the AWF installation failure reported in #8789, without changing published Primer React behavior.

Changes:

  • Regenerates the lock with gh-aw v1.0.1, updating AWF to v0.29.0 and refreshing setup-action and container pins.
  • Updates Copilot CLI installation and generated safe-output configuration.
  • Adds stricter log-redaction gates, detection readiness checks, and diagnostic artifacts.
File Description
.github/​workflows/​fix-flaky-tests.lock.yml Refreshes runtime pins and generated execution safeguards for flaky-test automation.

Review effort: Balanced

@joshblack

Copy link
Copy Markdown
Member Author

Closing in favor of: #8810

@joshblack joshblack closed this Nov 20, 2026
auto-merge was automatically disabled November 20, 2026 15:44

Pull request was closed

@joshblack
joshblack deleted the copilot/fix-flaky-tests-on-main branch November 20, 2026 15:44

This branch was successfully deployed

1 active and 1 inactive deployments
storybook-preview-8792 — 61a0eb78 Deployed Nov 19, 2026 by github-actions[bot]
github-pages — 61a0eb78 Deployed Nov 19, 2026 by joshblack via deploy-preview #34416
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

integration-tests: skipped manually Changes in this PR do not require an integration test skip changeset This change does not need a changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[aw] Fix flaky tests on main: failed before agent execution started

3 participants