Skip to content

Retain bounded scorer qualification diagnostics - #195

Merged
morgaesis merged 4 commits into
mainfrom
fix/scorer-report-diagnostics-20260911
Sep 11, 2026
Merged

morgaesis merged 4 commits into
mainfrom
fix/scorer-report-diagnostics-20260911

Conversation

@morgaesis

Copy link
Copy Markdown
Contributor

Scorer qualification failures need enough evidence to distinguish missing scoring from incomplete accounting. Add bounded failure codes and phase counters to retained reports while preserving every qualification decision and excluding response content.

@postil-dev postil-dev Bot left a comment

Copy link
Copy Markdown

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

info 1 advisory finding open
1 finding posted inline

Review details

Comment thread bench/src/scorer-eval.ts Outdated
@morgaesis
morgaesis merged commit 356941e into main Sep 11, 2026
10 checks passed
@morgaesis
morgaesis deleted the fix/scorer-report-diagnostics-20260911 branch September 11, 2026 03:40
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant