Skip to content

feat(agent-testing): show used models, rerun failures on their model, render rich content - #493

Merged
iceljc merged 2 commits into
SciSharp:mainfrom
yileicn:main
Oct 29, 2026
Merged

iceljc merged 2 commits into
SciSharp:mainfrom
yileicn:main

Conversation

@yileicn

@yileicn yileicn commented Oct 29, 2026 •

Copy link
Copy Markdown
Member

feat(agent-testing): show used models, rerun failures on their model, render rich content

  • Re-run Failures re-runs each failed case on the model it failed with
  • Label the agent-default row and case results with the models actually used
  • Show a turn's rich content as its own block on the run page

feat(agent-testing): pick an output assertion's target from content or richContent

  • A free-text target let typos through, and the backend fails the assertion on an unknown
    source instead of falling back to the reply text
  • "content" is stored as "reply", the value the backend expects; blank still means reply

… render rich content

- Re-run Failures re-runs each failed case on the model it failed with
- Label the agent-default row and case results with the models actually used
- Show a turn's rich content as its own block on the run page
…r richContent

- A free-text target let typos through, and the backend fails the assertion on an unknown
  source instead of falling back to the reply text
- "content" is stored as "reply", the value the backend expects; blank still means reply
@qodo-code-review

Copy link
Copy Markdown

Qodo reviews are paused for this user.

Troubleshooting steps vary by plan Learn more →

On a Teams plan?
Reviews resume once this user has a paid seat and their Git account is linked in Qodo.
Link Git account →

Using GitHub Enterprise Server, GitLab Self-Managed, or Bitbucket Data Center?
These require an Enterprise plan - Contact us
Contact us →

@iceljc
iceljc merged commit 0b80e6e into SciSharp:main Oct 29, 2026
1 of 2 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants