diff --git a/docs/RESULTS.md b/docs/RESULTS.md index d99dc02..4bd869f 100644 --- a/docs/RESULTS.md +++ b/docs/RESULTS.md @@ -217,6 +217,7 @@ The viable path to a sub-100MB browser tier is width reduction FROM a pretrained ByT5-small (closed-form stitch across widths, microkimi protocol), not from-scratch training. +[CORRECTED 2026-09-05: the 4.8218 figure below did not reproduce; the corrected 2.0 number is 5.08 (see the correction entry above).] ## ara-diac-small-1.0 — Arabic client tier (2026-08-24) Sequence-level KD from the r6 teacher (rababa_arabic_byt5/run-006-morph, diff --git a/models/ara-diac-small/ara-diac-small-2.0.README.md b/models/ara-diac-small/ara-diac-small-2.0.README.md index e0076ab..5907cbd 100644 --- a/models/ara-diac-small/ara-diac-small-2.0.README.md +++ b/models/ara-diac-small/ara-diac-small-2.0.README.md @@ -6,10 +6,12 @@ architecture and artifact size as 1.0: the **r7 canonical teacher** (2.2864; fresh greedy labels) and the **Muon optimizer** (E3-adopted). - 1.0 (r6 labels, AdamW): 8.26 full-set windowed DER-CE -- 2.0 (r7 labels, Muon): **4.82** (teacher r7 in-run: 2.289) +- 2.0 (r7 labels, Muon): **5.08** (teacher r7 in-run: 2.289; corrected + 2026-09-05 — the first-published 4.82 did not reproduce, see + docs/RESULTS.md) A 42% error reduction, pre-registered as E4 (gate ≤ 6.26; prediction -4.3–5.0 — landed at 4.82). The strict teacher+0.5pp gate is still +4.3–5.0 — landed at 5.08 after the 2026-09-05 correction). The strict teacher+0.5pp gate is still missed (+2.53pp, disclosed); the E2/E3 factorial attributes the residual to domain coverage. Identical IMF v1 contract: dynamic fetch, sha256-verified, KV decode, margins JSON alongside. diff --git a/models/ara-diac-small/ara-diac-small-2.0.metadata.yaml b/models/ara-diac-small/ara-diac-small-2.0.metadata.yaml index 64642c4..a08eda2 100644 --- a/models/ara-diac-small/ara-diac-small-2.0.metadata.yaml +++ b/models/ara-diac-small/ara-diac-small-2.0.metadata.yaml @@ -12,7 +12,7 @@ trained_from: 'sequence-level KD from the r7 canonical teacher (rababa_arabic_by 2.2864 windowed DER-CE full protocol): fresh greedy r7 labels on the same r5-units corpus/limits as ara-diac-small-1.0, Muon optimizer (E3-adopted), vanilla ByT5-small (E4, pre-registered gate <= 6.26). Checkpoint rababa-checkpoints:/rababa_arabic_distill_small/run-006-r7-muon/best. - The two measured wins compound: 8.259 -> 4.8218 full-set windowed DER-CE (teacher + The two measured wins compound: 8.259 -> 5.0821 full-set windowed DER-CE (corrected 2026-09-05 (teacher reproduces 2.289 in-run vs documented 2.2864) — a 42% error reduction on the 1.0 release at the same architecture and artifact size. Still misses the strict teacher+0.5pp gate (+2.53pp; miss disclosed); the E2/E3 factorial attributes the residual to domain @@ -25,7 +25,7 @@ metrics: the documented 2.2864 (r7 canonical teacher) source: interscript/interscript-ml docs/RESULTS.md#run-006-r7-muon - name: der_student_fullset - value: 4.8218 + value: 5.0821 protocol: same full-set harness; E4 (r7 teacher labels + Muon, vanilla ByT5-small) vs the 8.259 AdamW/r6-labels 1.0 release — a 42% error reduction at identical architecture and artifact size