Skip to content

Commit b74aa0e

Browse files
authored
Merge pull request #159 from interscript/release/ara-diac-small-2.1-int8
release: ara-diac-small-2.1-int8
2 parents f635d10 + f5f7ec3 commit b74aa0e

2 files changed

Lines changed: 51 additions & 0 deletions

File tree

models.yaml

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -304,4 +304,16 @@ models:
304304
- {name: der_teacher_fullset, value: 2.289, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
305305
- {name: der_student_fullset, value: 4.5701, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
306306
parity: {samples: 2480, cer_delta: 0.0714}
307+
ara-diac-small-2.1-int8:
308+
task: diacritization
309+
scripts: [Arab, Arab]
310+
precision: int8
311+
filename: ara-diac-small-2.1-int8.zip
312+
url: https://github.com/interscript/interscript-ml/releases/download/ara-diac-small-2.1/ara-diac-small-2.1-int8.zip
313+
sha256: 9b4e4aad2ab53a8cfbec432a78e27b409376627243aec3fd043f06574552a32b
314+
size: 267965657
315+
metrics:
316+
- {name: der_teacher_fullset, value: 2.289, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
317+
- {name: der_student_fullset, value: 4.5701, source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon}
318+
parity: {samples: 2480, cer_delta: 0.0857}
307319
license: BSD-3-Clause
Lines changed: 39 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,39 @@
1+
format: imf-v1
2+
id: ara-diac-small-2.1
3+
task: diacritization
4+
source_script: Arab
5+
target: Arab
6+
tokenizer: bytes
7+
opset: 14
8+
decoder: kv
9+
precision: int8
10+
license: BSD-3-Clause
11+
trained_from: 'sequence-level KD from the r7 canonical teacher (rababa_arabic_byt5/run-007-news/best,
12+
2.2864 windowed DER-CE full protocol): fresh greedy r7 labels on the same r5-units
13+
corpus/limits as ara-diac-small-1.0, Muon optimizer (E3-adopted), vanilla ByT5-small
14+
(E4, pre-registered gate <= 6.26). Checkpoint rababa-checkpoints:/rababa_arabic_distill_small/run-007-r7-muon-6ep/best.
15+
The two measured wins compound: 8.259 -> 4.8218 full-set windowed DER-CE (teacher
16+
reproduces 2.289 in-run vs documented 2.2864) — a 42% error reduction on the 1.0
17+
release at the same architecture and artifact size. Still misses the strict teacher+0.5pp
18+
gate (+2.53pp; miss disclosed); the E2/E3 factorial attributes the residual to domain
19+
coverage.'
20+
metrics:
21+
- name: der_teacher_fullset
22+
value: 2.289
23+
protocol: windowed DER-CE (1400-byte windows, word-boundary split, greedy, haraqat-projected,
24+
Misraj evaluator); full 1,200-paragraph SadeedDiac-25; in-run reproduction of
25+
the documented 2.2864 (r7 canonical teacher)
26+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
27+
- name: der_student_fullset
28+
value: 4.5701
29+
protocol: same full-set harness; E4 (r7 teacher labels + Muon, vanilla ByT5-small)
30+
vs the 8.259 AdamW/r6-labels 1.0 release — a 42% error reduction at identical
31+
architecture and artifact size
32+
source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon
33+
parity:
34+
samples: 2480
35+
cer_delta: 0.0857
36+
sha256:
37+
decoder-kv.onnx: 7fe2953bafb0955986b2ce2036da6077df5b7f1d9a9295265a1aa24b85961813
38+
decoder.onnx: affcca046189862be499aa6ce0d724a71d40507bd418882241d51cf6a277707a
39+
encoder.onnx: 61afa9ded2e61966a2966f906650715183f95cccc24bac699ed4c4b2d766eecd

0 commit comments

Comments
 (0)