Run smoke tests against a built quarto (binary mode)#14706

Draft

cderv wants to merge 37 commits into

mainfrom

test/smoke-tests-built-version

Commits on Jul 17, 2026

Add plan for running smoke tests against a built Quarto version

claude
authored and
cderv
committed
Revise built-version test plan per maintainer decisions

claude
authored and
cderv
committed
Add binary-mode classification results for all 133 smoke test files

claude
authored and
cderv
committed
Rewrite built-version test plan as grounded v2 design

claude
authored and
cderv
committed
Fold adversarial review findings into built-version test plan (v3)

claude
authored and
cderv
committed
Relax dev-only quarto-required fixtures and fix drafts-env env mutation

claude
authored and
cderv
committed
Add binary mode (QUARTO_TEST_BIN) to the smoke test harness

claude
authored and
cderv
committed
Migrate direct quarto() call sites to the runQuarto dispatch helper

claude
authored and
cderv
committed
Add built-version smoke testing CI: parameterize test-smokes.yml, add weekly workflow

claude
authored and
cderv
committed
Apply binary-mode env hygiene to subprocess-spawning tests

claude
authored and
cderv
committed
Fix binary-mode issues found by code review

claude
authored and
cderv
committed
Allow partial runs of the built-version smoke workflow via a buckets input

claude
authored and
cderv
committed
Extract shared build-dist-tarball composite action

claude
authored and
cderv
committed
Add nightly mode: test the signed artifacts of a no-publish create-release run

claude
authored and
cderv
committed
Document nightly mode and shared build action in the plan

claude
authored and
cderv
committed
Add isBinaryMode()/quartoTestBin() predicates for readable mode checks

claude
authored and
cderv
committed
Doc audit for binary-mode testing (part 1)

claude
authored and
cderv
committed
Add architecture diagrams for the test harness and CI modes

claude
authored and
cderv
committed
Simplify built-version workflow: schedule uses nightly artifacts, gh CLI resolution

claude
authored and
cderv
committed
Plan: record that the weekly schedule uses nightly mode

claude
authored and
cderv
committed
Built-version testing goes daily with three-OS coverage

claude
authored and
cderv
committed
Document the macOS-runner policy on the runners input

claude
authored and
cderv
committed
docs: purge stale weekly-cron wording after workflow_run migration

claude
authored and
cderv
committed
Use gh api for release-tag preflight check
cderv
committed
docs: add built-version testing architecture doc with design decision records

claude
authored and
cderv
committed
docs: add practical when-to-trigger guidance for built-version modes

claude
authored and
cderv
committed
ci: harden built-version workflows against review findings

claude
authored and
cderv
committed
tests: sanitize env for QUARTO_TEST_BIN --version probes

claude
authored and
cderv
committed
docs: drop the historical plan doc, point to the ADR instead
cderv
committed
tests: surface swallowed failures in custom-execute tests

claude
authored and
cderv
committed
tests: make editor-support and logging json-stream tests failable

claude
authored and
cderv
committed
tests: close silent-green paths found by testQuartoCmd call-site audit

claude
authored and
cderv
committed
tests: fix latent bugs the hardening commits surfaced
cderv
committed
tests: stop teardown ENOENT from masking render-failure reports
cderv
committed
tests: clean prepost artifacts in setup so verifyPath proves creation
cderv
committed
tests: split runQuarto by mode and add withCwd for chdir safety
cderv
committed
ci: TEMP push trigger + small bucket for branch shakedown
cderv
committed