Repository navigation

Test framework, stage 2: Catch2, its harness and converter, and llmath in one binary - #446

Merged

RyeMutt merged 55 commits into

developfrom

rye/tests-stage2

Oct 12, 2026

Merged

Test framework, stage 2: Catch2, its harness and converter, and llmath in one binary#446
RyeMutt merged 55 commits into
developfrom
rye/tests-stage2

Commits on Oct 11, 2026
- Catch2 comes from vcpkg when the tests are built
  
  RyeMutt
  and
  claude
  committed
  0d0cac1
- The Catch2 harness: a main, LL_ERRS as an exception, LOGFAIL, a state guard, an ordered teardown and LL matchers
  
  RyeMutt
  and
  claude
  committed
  6c94365
- al_add_test_binary builds many Catch2 test files into one binary and runs each in a process of its own
  
  RyeMutt
  and
  claude
  committed
  2c39ac2
- The Catch2 harness tests itself
  
  RyeMutt
  and
  claude
  committed
  218402e
- Catch2 comes from alchemy-registry, at 3.16.1
  
  RyeMutt
  and
  claude
  committed
  1ac2e23
- The Catch2 harness names the running test case, names the failure it throws, and compares memory byte for byte
  
  RyeMutt
  and
  claude
  committed
  6613281
- tut2catch.py converts TUT test files to idiomatic Catch2, deciding each assertion by the types clang resolved
  
  RyeMutt
  and
  claude
  committed
  cfd2172
- tut_parity.py proves a converted test file runs the same tests to the same results as its TUT original
  
  RyeMutt
  and
  claude
  committed
  ebb18dc
- The test harness's state guard may read the FP control register
  
  RyeMutt
  and
  claude
  committed
  e0a6e4e
- An ISA tier's test binary may share its files, and skips below the tree's tier too
  
  RyeMutt
  and
  claude
  committed
  08a02a5
- CI runs the Catch2 binaries' pending combined runs, and reports them without failing
  
  RyeMutt
  and
  claude
  committed
  40f4ffe
- tut2catch.py writes Catch2 that reports every failure and prints what it compared
  
  RyeMutt
  and
  claude
  committed
  8df7940
- The Catch2 harness prints every digit of a float
  
  RyeMutt
  and
  claude
  committed
  92f8c42
- llmath's tests are Catch2, in one binary
  
  RyeMutt
  and
  claude
  committed
  9a3d0d1
- llmath's tests read as Catch2 a person would write
  
  RyeMutt
  and
  claude
  committed
  bae1eeb
- The harness's own test names no variable near, which windows.h defines away
  
  RyeMutt
  and
  claude
  committed
  61c6507
- The default test run leaves out one label, manual, which benchmarks and pending combined runs carry
  
  RyeMutt
  and
  claude
  committed
  c44e889
- AL_TEST_PER_CASE configures, and its cases carry what a file's entry does
  
  RyeMutt
  and
  claude
  committed
  4c06fdf
- A per-case entry whose name has brackets gets its properties too
  
  RyeMutt
  and
  claude
  committed
  a88d588
- The Catch2 harness has ensure_distance's strict matcher, WithinDistance
  
  RyeMutt
  and
  claude
  committed
  03e47a7
- The Catch2 harness fails every run that ends badly, and says what ended it
  
  RyeMutt
  and
  claude
  committed
  f5a9d12
- al_add_test_binary passes the ISA level as one argument, and fails a case no file's entry runs
  
  RyeMutt
  and
  claude
  committed
  77cb2df
- CI keeps the build's test log and the combined run's JUnit, and the docs run what the build runs
  
  RyeMutt
  and
  claude
  committed
  9fe76d9
- mathmisc's cases run in TUT's order, and llmatrix4a stops where TUT stopped
  
  RyeMutt
  and
  claude
  committed
  68d7ff6
Commits on Oct 12, 2026
- tut_parity.py takes TUT's result for a test only from the entry that ran it
  
  RyeMutt
  and
  claude
  committed
  3f32f5d
- tut_parity.py holds a run's cases one by one, and its exit code to them
  
  RyeMutt
  and
  claude
  committed
  2634d9d
- tut_parity.py holds the cases to the order TUT ran their tests in
  
  RyeMutt
  and
  claude
  committed
  3f448df
- tut_parity.py holds every assertion in a passing case to having run
  
  RyeMutt
  and
  claude
  committed
  c1a6e97
- tut_parity.py --recounted still fails a case left with no assertion
  
  RyeMutt
  and
  claude
  committed
  7405bf9
- tut_parity.py holds the assertions outside every case to the mapping's file totals
  
  RyeMutt
  and
  claude
  committed
  945ef28
- tut_parity.py refuses inputs that are not of the run it checks
  
  RyeMutt
  and
  claude
  committed
  faf9451
- tut_parity.py checks a file built at several ISA tiers a tier at a time
  
  RyeMutt
  and
  claude
  committed
  cabb20b
- tut_parity.py counts a case's assertions in the body that ran
  
  RyeMutt
  and
  claude
  committed
  5fb4ffa
- tut_parity.py holds to having run only the assertions this build compiles
  
  RyeMutt
  and
  claude
  committed
  4cbc335
- tut_parity.py reads the harness's exit 1 as it now means
  
  RyeMutt
  and
  claude
  committed
  347a3b3
- tut2catch.py records a file its own bug stopped, traceback and all, and goes on
  
  RyeMutt
  and
  claude
  committed
  8aa8a73
- tut2catch.py finds the tut:: types production code befriends with a leading ::
  
  RyeMutt
  and
  claude
  committed
  7ec8a26
- tut2catch.py gives two cases one name only where one #if's branches part them
  
  RyeMutt
  and
  claude
  committed
  4144cf9
- tut2catch.py keeps a class derived from test_group that holds more than a name
  
  RyeMutt
  and
  claude
  committed
  e14ace1
- tut2catch.py splits and rewrites a condition only where the test wrote it, not a macro
  
  RyeMutt
  and
  claude
  committed
  a93039a
- tut2catch.py makes REQUIRE every guard a regression would crash past, and a chain's term a later one reads
  
  RyeMutt
  and
  claude
  committed
  81dc09c
- tut2catch.py declares a file's cases in the order TUT ran them, groups by name
  
  RyeMutt
  and
  claude
  committed
  1292358
- tut2catch.py writes ensure_distance as WithinDistance, in TUT's type and open interval
  
  RyeMutt
  and
  claude
  committed
  18d71ed
- tut2catch.py compares two string literals strcmp compared as a string_view
  
  RyeMutt
  and
  claude
  committed
  5cf16c3
- tut2catch.py's mapping holds each file's TUT hash and the assertions outside its tests
  
  RyeMutt
  and
  claude
  committed
  3ba8f47
- tut2catch.py ends a case at a chain's term only where a later term leans on it for safety
  
  RyeMutt
  and
  claude
  committed
  34b9eac
- tut2catch.py ends a case at a call that makes state only where that state is a bare local
  
  RyeMutt
  and
  claude
  committed
  d434b89
- tut2catch.py moves a test into a later block of its namespace, where TUT's order needs it
  
  RyeMutt
  and
  claude
  committed
  3c3ea5f
- tut2catch.py narrows ensure_approximately_equals_range's expected and delta to F32 too
  
  RyeMutt
  and
  claude
  committed
  b5b244c
- tut2catch.py's mapping holds the sha256 of each Catch2 file it wrote
  
  RyeMutt
  and
  claude
  committed
  054acab
- tut2catch.py leaves a && chain whole where a later term changes something
  
  RyeMutt
  and
  claude
  committed
  860deb9
- tut2catch.py takes a member for a size only where it answers with a bool or an integer
  
  RyeMutt
  and
  claude
  committed
  bf34f38
- tut_parity.py refuses a file edited since conversion unless --recounted, and a TUT binary older than its source
  
  RyeMutt
  and
  claude
  committed
  17a46c7
- CI runs the pending combined tests side by side, inside a step limit past CTest's
  
  RyeMutt
  and
  claude
  committed
  df2000b
- On Windows the Catch2 harness names the case an abort from any thread ended
  
  RyeMutt
  and
  claude
  committed
  b1e6aae

Commits

Commits on Oct 11, 2026

Commits on Oct 12, 2026