ml: the frontier leaderboard + client ladder; catalog to 23 models - #158
Merged
Conversation
P1 currency: client-tier card moves to ara-diac-small-2.1 (DER 4.57; 2.0 was 4.82, 1.0 was 8.26) with fp16 listed; ara-diac-layerdrop-1.0 added (DER 5.78 at 63% of parameters, int4 95 MiB browser tier); ara-diac-2.0 status released; section deck states the 23-model catalog. P2 the leaderboard section: protocol-matched SadeedDiac-25 table (every cell from the ledger; the Claude-3.7 row labeled vendor-published, protocol undisclosed, not reproduced by us), the 300M client ladder (8.26 - 5.29 - 4.82 - 4.57) with the five registered negatives named, and the Hebrew same-test line. Astro build clean; the built page emits dist/client/ml/index.html with the section.
This was referenced Sep 6, 2026
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
1 participant
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
What
The
/mlpage catches up with the close-out week (P1+P2 of the website plan).Currency
ara-diac-small-2.1— DER 4.57 (2.0 was 4.82, 1.0 was 8.26), int8 264 MiB + fp16 674 MiBara-diac-layerdrop-1.0— DER 5.78 at 63% of the parameters, int4 95 MiB (the browser-native tier)ara-diac-2.0status releasing -> releasedThe leaderboard section (
/ml#leaderboard)rababa/docs/RESULTS.mdand the ledger-verified paper table. The Claude-3.7-Sonnet row carries its disclosure label (vendor-published, protocol undisclosed, not reproduced by us). Ours r7 2.2864/1.3343 is the best dedicated model measured; the GLM regression rows follow with their protocol notes.Verification
astro buildclean; built output emitsdist/client/ml/index.htmlwith the section and all values./mlon pristine main too - control-run verified), so CI is the arbiter.Complements the
2026-09-05-frontier-closedblog post (narrative) with the living reference page.