Skip to content

Pull requests: open-compass/opencompass

New pull request New
94 Open 1,375 Closed
94 Open 1,375 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

[Fix] Support spawn workers in LiveCodeBench evaluation
#2603 opened Aug 20, 2026 by tandede Loading…
4 of 6 tasks
@acylam
[Feature] dump benchmark prompt hashcode in predictions and results and repair dump-only-message-path
#2602 opened Aug 19, 2026 by Myhs-phz Collaborator Loading…
[Fix] Restore missing comma in first_option_postprocess answer patterns
#2600 opened Aug 18, 2026 by jaideeppyne Loading…
docs: fix typos in gaokao_math and hellobench dataset READMEs
#2599 opened Aug 17, 2026 by bajiu-bajiu Loading…
4 tasks done
@bittersweet1999
fix(datasets): anchored grade extraction + surface judge failures in generic llmjudge
#2598 opened Aug 15, 2026 by YuhaoLin2005 Loading…
@tonysy
[Fix] Fix broken Star History chart in README
#2597 opened Aug 14, 2026 by OctoBored Loading…
@tonysy
[Fix] Fix EESE scoring of worded judge replies
#2594 opened Aug 12, 2026 by mkzung Loading…
3 of 6 tasks
[Fix] Fix OlympiadBench grading of factored answers
#2593 opened Aug 12, 2026 by mkzung Loading…
3 of 6 tasks
[feat]: Add biren supa backend supported
#2591 opened Aug 12, 2026 by frozenleaves Loading…
6 tasks
feat: add Atlas Cloud model config
#2590 opened Aug 10, 2026 by binyangzhu000-sudo Loading…
@bittersweet1999
Fix RJob failure propagation and submission logging
#2587 opened Aug 7, 2026 by JifeiShan Contributor Loading…
@tonysy
[Feat] vlmevalkit support
#2586 opened Aug 6, 2026 by thinszx Loading…
@acylam
[Fix] ELBench: scope the safety metric correctly and fix data-loading docs
#2585 opened Aug 4, 2026 by YL1N Loading…
@liushz
2
Package dataset runtime resources
#2584 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Bound OpenAI REST retries and requests
#2583 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix OpenAI SDK request forwarding
#2582 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix QuALITY hard accuracy calculation
#2581 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Harden CRUXEval output comparison
#2580 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix multi-replica metric aggregation
#2579 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix BABILong 2k config syntax
#2578 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Reject unsupported WildBench evaluation modes
#2577 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
Fix option matching without cushion
#2576 opened Aug 3, 2026 by Danielxu0208 Loading…
@bittersweet1999
[Dataset] Align ARC-AGI-1/2 evaluation with ARC Prize protocol
#2563 opened Jul 21, 2026 by Vicentvankor Loading…
@liushz
Add MedFailBench dataset adapter
#2560 opened Jul 18, 2026 by goktugozkanmd Loading…
@tonysy
3
fix: use last-match in generic LLM judge postprocess (verdict-injection defense)
#2534 opened Jul 14, 2026 by AUTHENSOR Loading…
3 tasks done
@liushz
ProTip! What’s not been updated in a month: updated:<2026-07-20.