feat(eval): capture the detail of every failing run, not just the winning one - #1816

Open

Tomkess wants to merge 6 commits into

feat/per-run-failure-capture

Commits on Sep 16, 2026

feat(eval): capture the detail of every failing run, not just the winning one

Tomkess
and
claude
committed
4378519
style(gooddata-eval): collapse _failed_run_record signature to satisfy ruff format

Tomkess
and
claude
committed
4d0e0ac

Commits on Sep 18, 2026

feat(eval): capture failing runs for the agentic kinds too, not just single-shot

Tomkess
and
claude
committed
c395483
fix(eval): keep the per-run records when every run went ungraded

Tomkess
and
claude
committed
545ebb9
fix(eval): type _attach_diagnostics against the errors it actually receives

Tomkess
and
claude
committed
740e52a
test(eval): pin the all-ungraded path for general_question behaviourally

Tomkess
and
claude
committed
66ee5a6