Repository navigation
testsuite, ci: rework the test matrix and expand coverage - #1122
Merged
Merged
Conversation
steadytao
force-pushed
the
rework-workflows
branch
5 times, most recently
from
October 8, 2026 17:11
3ae6b62 to
1cfbbe8
Compare
steadytao
force-pushed
the
rework-workflows
branch
from
November 9, 2026 19:23
a3b7b64 to
f7f3c6c
Compare
steadytao
force-pushed
the
rework-workflows
branch
from
November 11, 2026 11:33
c2ad56c to
f391d29
Compare
steadytao
force-pushed
the
rework-workflows
branch
2 times, most recently
from
November 13, 2026 13:00
a684dc5 to
4932fcf
Compare
steadytao
force-pushed
the
rework-workflows
branch
from
November 14, 2026 10:02
2f3af85 to
b798315
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Bluntly. This PR is way too large for someone to review, been working on it for a while. I assume no one will care enough to review either 🥲 But nonetheless. Proper description.
Summary
Rebuilds the testsuite around a Python 3.7 standard-library-only harness and replaces the fragmented workflows with one CI entry point. Tests now declare their transports, protocol limits, peer-version limits and required capabilities. Platform profiles distinguish tests which do not apply from capabilities a system lacks. Every run produces a machine-readable receipt which records the selected tests, outcomes, environment and tested binaries.
Test harness
CI
CI / Required.rsync, restricted SSH and local TLS with certificate and hostname verification.--copy-asusing disposable filesystems.Pull requests select checks from their changed paths. Documentation-only changes run Changes and Required. Testsuite and CI changes run their owning platforms and diagnostics. Production, build, packaging and unknown paths run the complete matrix. Pushes to
masterand manual runs also select the complete matrix.Required rejects a failed selector, a missing family, an unexpected skip, a failed child job or a selected job which did not run.
Interoperability
Seven native endpoints cover Linux, FreeBSD, NetBSD, OpenBSD, macOS, Solaris and Cygwin.
Every ordered platform pair is exercised through push and pull operations over SSH and daemon transports, giving 168 directed data-transfer cases. The same system also checks updates, deletion, ACL and xattr handling, unsupported metadata, fake-super backup restoration and network isolation.
Endpoint jobs have read-only GitHub permissions and no federated identity. A trusted controller issues encrypted single-use Tailscale enrolment keys, admits only the recorded cohort then revokes its grant, keys and devices. Cleanup is independently recoverable from an attested lease.
Startup waits account for hosted-runner queueing. Interoperability SSH uses bounded connection retries and Cygwin restores Windows Git before checkout cleanup.
Release integration
Release archive construction now has one implementation shared by the release process and archive qualification. Generated files are validated before packaging and archived peer binaries remain excluded from release tarballs.
make check, protocol-specific checks, coverage and installed-binary checks use the new runner directly.