Skip to content

fix: harden structured output parsing in LLM-as-a-judge implementation; harden reference files in LLM-as-a-judge prompt - #390

Merged
artus9033 merged 4 commits into
mainfrom
perf/optimize-judge
Sep 30, 2026
Merged

fix: harden structured output parsing in LLM-as-a-judge implementation; harden reference files in LLM-as-a-judge prompt#390
artus9033 merged 4 commits into
mainfrom
perf/optimize-judge

Conversation

@artus9033

@artus9033 artus9033 commented Sep 30, 2026

Copy link
Copy Markdown
Contributor

This PR:

  • hardens structured output parsing in LLM-as-a-judge logic to reduce back-and-forths
  • hardens usage of reference files in the LLM-as-a-judge prompt

thymikee
thymikee approved these changes Sep 30, 2026
View reviewed changes

@thymikee thymikee left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

test it and ship

@artus9033
artus9033 merged commit 816b10d into main Sep 30, 2026
4 checks passed
@artus9033
artus9033 deleted the perf/optimize-judge branch September 30, 2026 19:22
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Reviewers

@thymikee thymikee thymikee approved these changes

Assignees

No one assigned

Labels

None yet

Projects

None yet

Milestone

No milestone

Development

Successfully merging this pull request may close these issues.

2 participants

@artus9033 @thymikee