bench: track small u8 dictionary take - #9566
Performance Regression: -12.04%
⚠️ Unknown Walltime execution environment detected
Using the Walltime instrument on standard Hosted Runners will lead to inconsistent data.
For the most accurate results, we recommend using CodSpeed Macro Runners: bare-metal machines fine-tuned for performance measurement consistency.
⚠️ Different runtime environments detected
Some benchmarks with significant performance changes were compared across different runtime environments,
which may affect the accuracy of the results.
❌ 2 regressed benchmarks
✅ 1979 untouched benchmarks
🆕 6 new benchmarks
⏩ 54 skipped benchmarks1
Warning
Please fix the performance issues or acknowledge them on CodSpeed.
Performance Changes
| Mode | Benchmark | BASE |
HEAD |
Efficiency | |
|---|---|---|---|---|---|
| ❌ | WallTime | words_gather_scalar_avx2[65536] |
8.3 µs | 9.4 µs | -12.48% |
| ❌ | Simulation | cold_misaligned[(16, 64)] |
380.2 µs | 430.1 µs | -11.59% |
| 🆕 | WallTime | dict_canonicalize_gt_u8_neon[1000000] |
N/A | 546.5 µs | N/A |
| 🆕 | WallTime | dict_canonicalize_gt_u8_neon[16000000] |
N/A | 8.7 ms | N/A |
| 🆕 | WallTime | dict_canonicalize_gt_u8_avx512[1000000] |
N/A | 419.7 µs | N/A |
| 🆕 | WallTime | dict_canonicalize_gt_u8_avx512[16000000] |
N/A | 6.8 ms | N/A |
| 🆕 | WallTime | dict_canonicalize_gt_u8_avx2[1000000] |
N/A | 420.4 µs | N/A |
| 🆕 | WallTime | dict_canonicalize_gt_u8_avx2[16000000] |
N/A | 6.8 ms | N/A |
Tip
Investigate this regression by commenting @codspeedbot fix this regression on this PR, or directly use the CodSpeed MCP with your agent.
Comparing ji/small-u8-table-take-benchmark (d49393c) with develop (ef43456)
Footnotes
-
54 benchmarks were skipped, so the baseline results were used instead. If they were deleted from the codebase, click here and archive them to remove them from the performance reports. ↩