Skip to content

docs: ara-tiny verdict restored (clean labels); resume guard for checkpoint lineages - #38

Merged
ronaldtse merged 3 commits into
mainfrom
docs/ara-tiny-final
Aug 24, 2026
Merged

docs: ara-tiny verdict restored (clean labels); resume guard for checkpoint lineages#38
ronaldtse merged 3 commits into
mainfrom
docs/ara-tiny-final

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

Summary

  • ara-tiny clean-label re-run restores the capacity verdict: 82.87% DER-CE vs teacher 1.32% — failure mode is total (immediate EOS under free running; fits under teacher forcing at CE 1.55). The 30MB tier is closed with unconfounded evidence across both task families
  • resume guard: today's clean-label ara-diac-small run silently resumed from step-10500 of the POISONED run (500 clean steps on a converged mojibake model — a model scoring clean labels at 1.33 loss while generating mojibake). Step checkpoints now record the labels-file digest; resume ignores mismatched lineages. Poisoned checkpoints purged; ara-diac-small retraining from scratch

Test plan

  • CI green
  • ara-diac-small retrains and its gate eval scores a real DER

Ronald Tse added 3 commits August 24, 2026 12:00
Today's clean-label run resumed from step-10500 of yesterday's poisoned
run — 500 clean steps on a converged mojibake model, giving a model
that scores clean labels at 1.33 loss yet generates mojibake. Each
step checkpoint now records the sha of the labels file it was trained
on; resume ignores checkpoints from a different labels lineage.
@ronaldtse
ronaldtse merged commit 2621455 into main Aug 24, 2026
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant