Skip to content

Latest commit

 

History

History
7 lines (4 loc) · 562 Bytes

README.md

File metadata and controls

7 lines (4 loc) · 562 Bytes

XDecideBench

XDecideBench is a benchmark of typed decisions across languages. A typed decision is a probability distribution over a declared, finite output space: one of k options, yes/no, or an ordinal level. The benchmark scores the submitted distributions, not generated text, on nine suites in 122 languages, and checks whether confidence policies fitted in English hold in other languages.

Citation

Marek Šuppa and Jaroslav Kopčan. XDecideBench: Evaluating Typed Decision Models and Confidence Policies Across Languages. 2026. arXiv preprint.