Skip to content

Commit 9f85df9

Browse files
Ronald Tseronaldtse
authored andcommitted
docs: layerdrop full-set verdict 7.44 — the frontier is complete, third subset-overstatement instance
1 parent 3fe2c1d commit 9f85df9

2 files changed

Lines changed: 37 additions & 0 deletions

File tree

docs/PUBLICATION-NOTES.md

Lines changed: 12 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -157,3 +157,15 @@ reproducing 1.3205 across all three measurements as the harness
157157
control. Next rung on the frontier: stitch-down from ByT5-small
158158
pretraining (ridge-fit width bridge), which changes init, not data or
159159
capacity alone.
160+
161+
## layerdrop full-set (2026-08-31): the frontier is complete
162+
163+
7.4413 at 63% of parameters - better than the shipped 1.0, 2.15pp
164+
behind its optimizer-matched full-depth peer. For paper B this closes
165+
the capacity section: a monotone five-point size-quality frontier
166+
(scratch, width-stitch, depth-cut, optimizer-matched, teacher-matched)
167+
with every rung measured full-set under one harness. The subset
168+
overstatement now has three quantified instances - it is a finding,
169+
not a nuisance: domain-neighborhood evaluation subsets inflate student
170+
quality by 2-4x in this regime. Frame it in the measurement section as
171+
a generalizable warning with the three pairs as evidence.

docs/RESULTS.md

Lines changed: 25 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -387,3 +387,28 @@ representation survives a depth cut that width surgery destroyed.
387387
Full-set gate (1,200 paragraphs) in flight; int8 ~190MB, int4 ~95MB
388388
(the browser-budget artifact). Survived two infra failures en route
389389
(eviction without watchdog; a regressed d_kv derivation) - both fixed.
390+
391+
## ara-diac-small-layerdrop — full-set verdict: 7.44 (2026-08-31)
392+
393+
The 1,200-paragraph gate (teacher reproduces 2.5815):
394+
395+
| rung | params | full-set DER-CE | subset DER-CE |
396+
|---|---|---|---|
397+
| 1.0 (full depth, AdamW, r6) | 300M | 8.259 | 3.658 |
398+
| **layerdrop (enc 6, Muon, r6)** | **~190M (63%)** | **7.4413** | 3.8088 |
399+
| r6 + Muon (full depth) | 300M | 5.2945 ||
400+
| 2.0 (r7 + Muon, full depth) | 300M | 4.8218 ||
401+
| scratch d384 | 33M | 74.68 | 83.08 |
402+
| SVD width-stitch d384 | 29M | 82.96 ||
403+
404+
Reading: halving encoder depth + Muon BEATS full-depth AdamW (7.44 vs
405+
8.26) at 63% of the parameters — but the depth cut costs 2.15pp against
406+
its optimizer-matched peer (5.29). Strict gate (teacher+0.5) failed.
407+
This is the THIRD instance of the first-300 subset overstating quality
408+
(3.66 vs 8.26; 3.81 vs 7.44) — the subset sits in the training-domain
409+
neighborhood; full-set-only stands as the publication rule, now with a
410+
quantified repeat rate. The size-quality frontier is complete and
411+
monotone: 33M/74.7 - 29M/83.0 - 190M/7.4 - 300M/5.3 - 300M/4.8
412+
(teacher 2.28-2.58). Browser-tier decision (user): ship
413+
layerdrop-int4 (~95MB, ~7.5 DER with int4 flip risk ungated) as the
414+
lite rung, or hold the tier at 2.0-int8 (264MB, 4.82).

0 commit comments

Comments
 (0)