Skip to content

feat: ara-diac-small-2.0 — E4 landed at 4.8218 (8.26 → 4.82, 42% error reduction) - #84

Merged
ronaldtse merged 1 commit into
mainfrom
feat/ara-diac-small-2
Aug 29, 2026
Merged

feat: ara-diac-small-2.0 — E4 landed at 4.8218 (8.26 → 4.82, 42% error reduction)#84
ronaldtse merged 1 commit into
mainfrom
feat/ara-diac-small-2

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

What

ara-diac-small-2.0 — the client-tier upgrade, retargeted to the run E4 pre-registered.

Built on the branch's original run-005 target (5.2945) and updated when E4 landed better, exactly as the original metadata anticipated ("an r7-teacher re-distillation is in flight and expected to supersede"): run-006-r7-muon = 4.8218 full-set windowed DER (gate ≤6.26, registered prediction 4.3–5.0; teacher r7 reproduces 2.289 vs documented 2.2864).

  • 8.259 → 4.822: a 42% error reduction at identical architecture (vanilla ByT5-small) and artifact size — r7 canonical-teacher labels + the E3-adopted Muon optimizer.
  • Strict teacher+0.5pp gate still missed (+2.53pp) — disclosed in metadata and README; the E2/E3 factorial attributes the residual to domain coverage.
  • Provenance: RESULTS.md run-006-r7-muon section; EXPERIMENTS.md E4 (pre-registered); export entry ara-diac-small-2 → run-006 checkpoint.
  • Zips exported (fp32/fp16/int8-with-fp32-head); the parity+margin gate is running with the resumable reference decode.

The E4 arm completed as pre-registered (gate ≤6.26, prediction 4.3-5.0):
r7 canonical teacher labels + Muon on the vanilla ByT5-small scores
4.8218 full-set (teacher reproduces 2.289), superseding the run-005
rung (5.2945) this branch originally targeted — as its own metadata
anticipated. 42% error reduction vs the shipped 1.0 at identical
architecture and artifact size. Strict teacher+0.5pp gate still missed
(+2.53pp), disclosed.
@ronaldtse
ronaldtse force-pushed the feat/ara-diac-small-2 branch from ab4fc85 to 1140883 Compare August 29, 2026 09:58
@ronaldtse
ronaldtse merged commit 0d94f39 into main Aug 29, 2026
9 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant