Skip to content

Commit 5343557

Browse files
authored
Merge pull request #156 from interscript/gkd-verdict
docs: GKD negative verdict
2 parents 953c7ae + 6c427ce commit 5343557

1 file changed

Lines changed: 20 additions & 0 deletions

File tree

docs/RESULTS.md

Lines changed: 20 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -0,0 +1,20 @@
1+
2+
## ara-diac-small-2-gkd — on-policy distillation NEGATIVE: 6.0036 (2026-09-06)
3+
4+
The on-policy rung (GKD: student-generated mistakes scored by the
5+
teacher, a120384 wiring, 10,995 steps, labels sha e70ce991): teacher
6+
reproduces 2.289, student **6.0036** full-set, paired bootstrap delta
7+
3.4083 [3.109, 3.743], p=0 — gate FAILED, and 1.43pp WORSE than the
8+
off-policy sequence-KD rung it was meant to improve (G2a 4.5701).
9+
10+
This completes the residual-attribution program with a clean pattern:
11+
every lever tested fails to close the teacher-student gap —
12+
* classical corpus add (G2b): flat-negative
13+
* register swap (E6): negative
14+
* on-policy distillation (GKD): negative, worse than off-policy
15+
* memory layers (PKM): real but small (0.70pp), below bar
16+
* epochs: small (0.25pp)
17+
The residual is not data, not domain coverage, not an off/on-policy
18+
deficit. It is a property of the compression itself at this rung —
19+
the honest open question for the paper. On-policy stays listed in
20+
Paper B's future work with its measured negative attached.

0 commit comments

Comments
 (0)