Skip to content

Deploy the tested web commit and verify its public read paths - #127

Merged
lwwmanning merged 6 commits into
mainfrom
claude/port-bench-38-deploy-verification
Oct 28, 2026
Merged

lwwmanning merged 6 commits into
mainfrom
claude/port-bench-38-deploy-verification

Conversation

@lwwmanning

Copy link
Copy Markdown
Contributor

Port vortex-data/benchmarks-website#38 by Connor Tsui. After each deploy, verify-web-deploy.mjs checks that /api/health reports the deployed commit, that typical group and chart responses and the HTML pages load, and that the CDN returns a cache hit. Production is checked on the public domain, and a failed check fails the run. Previews are behind Vercel Authentication, so they report verification as blocked. Push and manual production runs now share one queue. The check passes against current production in 6 seconds.

This PR is stacked on #126. The second commit ports Connor's workflow changes into bench-deploy.yml and bench-ci.yml. It leaves out his shared check action, because bench CI is already a required check on main.

Part of #113.

🤖 Generated with Claude Code

connortsui20 and others added 4 commits October 28, 2026 20:24
…failure

Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Will Manning <will@willmanning.io>
#37 changed the standalone repository's schema-deploy.yml and web-ci.yml,
which became bench-schema-deploy.yml and bench-ci.yml in this repository.

- bench-schema-deploy prepares the migration interpreter in its own step,
  so a dependency failure can no longer pass as dry-run drift. A dry run
  now treats exit 1 as drift and any other non-zero exit as a failure.
- bench-ci installs uv and runs the migration-runner tests. The web
  integration suite now also calls the runner through uv.
- uv resolves the runner's Python dependencies when it runs, so both
  workflows set UV_EXCLUDE_NEWER to 14 days ago, matching the repository's
  cooldown.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Will Manning <will@willmanning.io>
Signed-off-by: Connor Tsui <connor.tsui20@gmail.com>
Signed-off-by: Will Manning <will@willmanning.io>
#38 changed the standalone repository's web-deploy.yml and added a shared
web-checks action. In this repository:

- Push and manual production runs share one concurrency group and never
  cancel an active run. A newer preview can cancel an older one.
- A production deploy requires BENCH_SITE_BASE_URL to be an HTTPS URL.
- The build embeds BENCH_BUILD_SHA. After the deploy, verify-web-deploy.mjs
  checks the build commit, the read paths and CDN caching.
- bench-ci runs the script's tests.

The web-checks action and the pre-deploy check job are left out: bench CI
is a required check on main, so merged code has already passed it.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Will Manning <will@willmanning.io>
@vercel

vercel Bot commented Oct 28, 2026 •

Copy link
Copy Markdown

The latest updates on your projects. Learn more about Vercel for GitHub.

Project Deployment Actions Updated
vortex Ready Ready Preview Oct 28, 2026 7:37pm UTC

Request Review

@chatgpt-codex-connector

chatgpt-codex-connector Bot commented Oct 28, 2026 •

Copy link
Copy Markdown

Codex Review Summary

This comment shows the latest Codex review activity on this pull request.

Review Status Commit Review trigger
📝 Code Review ✅ Completed 2026-10-28T19:39:08.529493Z afa06b9 New commits
ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review" or "@codex security review".

Codex reacts with 👀 while any review is running, comments if it has suggestions, and reacts with 👍 once all reviews finish with no findings.

Base automatically changed from claude/port-bench-37-migration-checks to main October 28, 2026 19:31

@chatgpt-codex-connector chatgpt-codex-connector Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

💡 Codex Review

Here are some automated review suggestions for this pull request.

Reviewed commit: 450275c056

ℹ️ About Codex in GitHub

Your team has set up Codex to review pull requests in this repo. Reviews are triggered when you

  • Open a pull request for review
  • Mark a draft as ready
  • Comment "@codex review".

If Codex has suggestions, it will comment; otherwise it will react with 👍.

Codex can also answer questions or update the PR. Try commenting "@codex address that feedback".

Comment thread .github/workflows/bench-deploy.yml Resolved
lwwmanning and others added 2 commits October 28, 2026 20:36
…deploy-verification

# Conflicts:
#	.github/workflows/bench-ci.yml
Codex pointed out that the port dropped #38's pre-deploy checks. Required
PR checks do not cover the deployed commit: main takes squash merges
without requiring an up-to-date branch, and Bench CI on main runs beside
bench-deploy, not before it. So a merged commit could ship unchecked.

Restore Connor's design. Bench CI's steps move into the bench-checks
composite action. Bench CI runs it, and bench-deploy runs it in a checks
job on the commit it deploys, with the deploy job needing that job.

The required merge check docs pointed at develop, the old check name and
the old repository. They now describe vortex.dev's main ruleset and the
deploy-time check.

Co-Authored-By: Claude Opus 5.5 <noreply@anthropic.com>
Signed-off-by: Will Manning <will@willmanning.io>
@github-actions

Copy link
Copy Markdown

🔦 Lighthouse audit

URL Perf A11y Best practices SEO Report
/ 🟡 85 🟢 100 🟢 96 🟢 100 report
/blog 🟢 100 🟢 100 🟢 96 🟢 100 report
/blog/btrblocks-compressor 🟢 100 🟢 96 🟢 96 🟢 100 report

Run 40755984907 · 2026-10-28 19:39 UTC

@github-actions

Copy link
Copy Markdown

Bench preview for afa06b97068196b58fccb99264fe0b56138e2739: https://benchmarks-website-8qvn96lt7-vortex-data.vercel.app

@lwwmanning
lwwmanning merged commit 78339ba into main Oct 28, 2026
22 checks passed
@lwwmanning
lwwmanning deleted the claude/port-bench-38-deploy-verification branch October 28, 2026 19:40

This branch was successfully deployed

2 active deployments
bench-preview — afa06b97 Deployed Oct 28, 2026 by lwwmanning via Build & deploy to Vercel #30
Preview — afa06b97 Deployed Oct 28, 2026 by vercel[bot]
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants