Skip to content

Evaluation set (20 apps) and the false alarms it found - #23

Merged
thelastbackspace merged 2 commits into
mainfrom
fix/eval-false-alarms
Nov 7, 2026
Merged

thelastbackspace merged 2 commits into
mainfrom
fix/eval-false-alarms

Conversation

@thelastbackspace

Copy link
Copy Markdown
Owner

npm run eval: 12 planted problems, 8 clean apps; CI fails on misses or false alarms. Before: 17/17 found, 15 false alarms. After: 17/17, 0. See CHANGELOG.

npm run eval scores traceperf run on 12 apps with a planted problem and
8 clean ones; CI fails on a miss or a false alarm. It started at 17/17
found with 15 false alarms, from:
- parallel calls each reported as dominant
- blocking reported as blocking, queueing and busy at once
- per-tree appendFileSync showing up as the app's CPU cost
Now 17/17 and none.
@thelastbackspace
thelastbackspace merged commit 5f46ac8 into main Nov 7, 2026
15 checks passed
@thelastbackspace
thelastbackspace deleted the fix/eval-false-alarms branch November 7, 2026 09:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant