Supplement the tests by comparing the benchmark results across different platforms. #31

Activity

1. EndrII

   assigned

   QuasarAppCI

   on Nov 12, 2026
2. EndrII

   added the

   Task

   issue type on Nov 12, 2026
3. EndrII

   closed this as completedon Nov 12, 2026
4. EndrII

   reopened this on Nov 12, 2026
5. EndrII

   changed the title [-]add support of tests[/-] [+]Supplement the tests by comparing the benchmark results across different platforms.[/+] on Nov 12, 2026
6. QuasarAppCI

   added

   in progress

   on Nov 12, 2026
7. QuasarAppCI commented on Nov 12, 2026

   

   QuasarAppCI

   on Nov 12, 2026

   Member

   More actions

   Checklist (issue #31):

   • Analyze the issue and the existing CI/test setup
   • Add a cross-platform benchmark test covering all OpenSimplex2F noise functions (same seed, same input parameters)
   • Add a new GitHub Actions workflow that runs the benchmark on all three platforms (Linux, Windows, macOS)
   • Make the workflow wait for all three platform jobs and compare the results byte-for-byte (they must match perfectly)
   • Verify locally: build + run the benchmark, output is deterministic
   • Run git diff check, push branch task_31 and create the PR
   • Update the checklist and set the label to waiting-for-review
8. QuasarAppCI

   added

   waiting-for-review

   and removed

   in progress

   on Nov 12, 2026
9. QuasarAppCI commented on Nov 12, 2026

   

   QuasarAppCI

   on Nov 12, 2026

   Member

   More actions

   Checklist (issue #31) — completed, PR: #33

   • Analyze the issue and the existing CI/test setup
   • Add a cross-platform benchmark test covering all OpenSimplex2F noise functions (same seed, same input parameters) — tests/test_OpenSimplex2F_cross_platform.c evaluates all nine noise functions (2D/3D/4D variants), 37107 values, and prints the exact binary64 bit pattern of every result plus an FNV-1a checksum
   • Add a new GitHub Actions workflow that runs the benchmark on all three platforms (Linux, Windows, macOS) — .github/workflows/cross-platform-compare.yml, benchmark matrix job
   • Make the workflow wait for all three platform jobs and compare the results byte-for-byte (they must match perfectly) — compare job with needs: benchmark, cmp + sha256/FNV-1a checksums
   • Verify locally: build + run the benchmark, output is deterministic (re-run and an -O0 build produce bit-identical reports; existing PNG test still passes 3/3)
   • Run git diff check, push branch task_31 and create the PR (Cross-platform noise benchmark comparison (issue 31) #33)
   • Update the checklist and set the label to waiting-for-review
10. EndrII

    closed this as completedon Nov 12, 2026
11. EndrII

    removed

    waiting-for-review

    on Nov 12, 2026