Skip to content

fix(website): show the current Snowflake syntax figure and fail CI when it drifts - #246

Merged
kvlonge merged 1 commit into
mainfrom
fix/website-coverage-figures
Nov 16, 2026
Merged

kvlonge merged 1 commit into
mainfrom
fix/website-coverage-figures

Conversation

@kvlonge

@kvlonge kvlonge commented Nov 16, 2026

Copy link
Copy Markdown
Contributor

Why

sqlquack.io, the docs coverage page and llms.txt still showed 71% (2,388 of 3,351 Snowflake forms, as of 6 November). Nobody updated website/src/data/figures.json when the verified count rose, and nothing compared it with the coverage summary.

Changes

  • figures.json now shows 3,199 of 3,351 forms (95.46%), dated 16 November 2026. make website-figures-update wrote these values from syntax-coverage summary --evidence <pinned>/syntax/snowflake --json. The summary needs --evidence because the cases and receipts now live in the pinned evidence repository.
  • New make website-figures, part of check-ci: it fails when SYNTAX_VERIFIED, SYNTAX_FORMS or SYNTAX_PCT differ from the summary on the PR head, or when SYNTAX_BASIS does not start with the verified count.
  • Replay scope: a change to figures.json alone now runs the code checks, so the figure check runs on it.
  • Docs coverage page: the reproduce command includes --evidence, and the hand-written form count is gone.

Verification

  • make website-figures fails on the old figures and passes on the new ones.
  • New unit tests: write then check round-trips, and a stale share or basis fails. The replay-scope case fails without the scope change.
  • ruff, fensu and make check-ci RECORDER=0 pass on the head.

…en it drifts

The website still showed 2,388 of 3,351 forms from 6 November. The figures
are now written from the Snowflake coverage summary, and check-ci fails
while website/src/data/figures.json differs from it.
@kvlonge
kvlonge enabled auto-merge November 16, 2026 07:00
@kvlonge
kvlonge added this pull request to the merge queue Nov 16, 2026
Merged via the queue into main with commit 28dab7b Nov 16, 2026
9 checks passed
@kvlonge
kvlonge deleted the fix/website-coverage-figures branch November 16, 2026 08:17
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant