TamilLingBench: English→Tamil machine translation benchmark for obligatory verb agreement (rationality, gender, number). Tests whether MT evaluation metrics such as COMET, xCOMET, MetricX and CometKiwi catch wrong Tamil agreement. Code, data and model outputs for the WMT 2026 paper "Obligatory Slots".
nlp benchmark translation morphology machine-translation comet computational-linguistics tamil quality-estimation finite-state-transducer evaluation-metrics interpretability wmt mt-evaluation dravidian-languages llm-evaluation activation-patching metricx challenge-set english-tamil
-
Updated
Sep 12, 2026 - Python