From df889995c48be0c97d67d2a3144e4b129111da79 Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Wed, 2 Sep 2026 18:25:46 +0200 Subject: [PATCH] =?UTF-8?q?docs:=20E6=20rung=20register=20statuses=20?= =?UTF-8?q?=E2=80=94=20gate=20FAILED=20at=205.8057,=20not=20adopted?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- TODO.publish/02-e6-verdict.md | 15 ++++++++++----- TODO.training-work/04-label-scale-rung.md | 10 +++++++--- 2 files changed, 17 insertions(+), 8 deletions(-) diff --git a/TODO.publish/02-e6-verdict.md b/TODO.publish/02-e6-verdict.md index 00e4905..a500018 100644 --- a/TODO.publish/02-e6-verdict.md +++ b/TODO.publish/02-e6-verdict.md @@ -1,10 +1,15 @@ # 02 — E6 verdict (constant-budget register diversification) -Status: IN FLIGHT (2026-09-02). Training COMPLETE — all 11,073 steps, -final CE ~0.003-0.008 (run-008-tashkeela-mix; /tmp/e6_distill2.log). -`modal_distill.py::main` does not chain the final eval, so -`evaluate_der` was launched separately (/tmp/e6_evalder.log, -resumable, writes final_eval.json). +Status: COMPLETE (2026-09-02). Training finished all 11,073 steps; +`evaluate_der` (launched separately — `main` doesn't chain it) +returned **student 5.8057 / teacher 2.289** (n=1200). **GATE FAILED +at 5.8057** (gate <=4.5218, control 4.8218, E5's failed 5.0853); +NOT ADOPTED. Paired bootstrap student−teacher +3.2388pp, CI +[2.939, 3.575]. Prediction (4.45-4.75) missed. Recorded: +EXPERIMENTS.md E6 status, PUBLICATION-NOTES §8 negative pair +(E5+E6) + Paper-B paragraph (the causal test failed in the swap +direction; G2b's 48k add is the live test). ara-diac-small-2.x +material NOT triggered — release question moot. ## Registered (EXPERIMENTS.md, gate before launch) diff --git a/TODO.training-work/04-label-scale-rung.md b/TODO.training-work/04-label-scale-rung.md index b6875bc..067822a 100644 --- a/TODO.training-work/04-label-scale-rung.md +++ b/TODO.training-work/04-label-scale-rung.md @@ -1,8 +1,12 @@ # 04 — Label-scale rung (A1a): diversify the student's domain mix -Status: TO BUILD. The E2/E3/E4 factorial attributes the remaining -~2.0pp of client-tier gap to domain coverage; the current mix is -news-heavy (r5-units/domain.txt + replay.txt, teacher-labeled by r7). +Status: COMPLETE (2026-09-02) — **GATE FAILED: 5.8057** (gate +<=4.5218; control 4.8218; worse than E5's 5.0853). NOT ADOPTED. +Swapping 8k news units for classical Tashkeela at constant 30k +total HURT (−0.98pp vs control); teacher reproduced at 2.289. +Verdict recorded in EXPERIMENTS.md E6 + PUBLICATION-NOTES §8/§B +(the E5/E6 data-vs-architecture negative pair). Direction shifts to +the add side (G2b, 48k total, in flight). See TODO.publish/02. ## Design