From 73918178678fbaa20a69947ae04a68146f269937 Mon Sep 17 00:00:00 2001 From: tannevaled Date: Wed, 23 Sep 2026 19:14:13 +0200 Subject: [PATCH 1/3] landing: the runtime conformance story, which the site did not tell at all MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit Neither the landing page nor the /performance/ page mentioned ruby/spec, the ratchet or a floor anywhere: the whole conformance story on this site was the 2026-06 front-end sweep. That sweep is three months old and is not what the project has been doing since. Measured on rbgo main (68cb53a), darwin/arm64, pinned corpus, four runs: 21845 / 21903 / 21901 / 21902, floor 21740. A second sweep gives the denominator: 21901 of 24044 examples that ran, 473 skipped, 15 of 2206 files producing no result. * hero trust line and a stat tile now carry 21,901 ruby/spec examples and the 21,740 floor, and say which is which * the "Conformance-first" card leads with the runtime measure; the front-end figures stay but are dated 2026-06 * /performance/ gets a "Runtime conformance — ruby/spec" card with the numbers, the floor-is-not-the-score point, and the note that two recent jumps were fixes to the MEASUREMENT (the mspec shim; a parser upgrade that made 13 previously-unparseable spec files visible) rather than to the VM * hugo.toml Phase 8 blurb led with the same Counts and links, against rbgo's go.mod: * "184 standalone pure-Go modules ... all bound into rbgo" -> 178 modules across 176 orgs; the strip lists 127, so it is now presented as a selection * the same 184 in the stat tiles * hugo.toml said 71 bound out of 104 family libraries * seven strip links pointed at go-ruby-/ orgs that do not exist (commonmark, kramdown, liquid, mustache, nokogiri, rouge, xslt live at go-/), and go-ruby-set/set is not bound at all -- Set is in-tree * phases 2 and 5 were "active" where the interpreter's plan-rbgo.md marks both DONE (core) The terminal demo showed a command and an output line that appear nowhere in the project ("$ rbgo -e 'require \"puppet\"' apply site.pp" / "Applied catalog in 0.04s - exit 0"). Replaced with the transcript the repo records in CONFORMANCE-RAILS-PUPPET.md and its README. I did not re-run Puppet myself; this swaps an unattested transcript for an attested one. Co-Authored-By: Claude Opus 5 --- hugo.toml | 6 +++--- layouts/_default/list.html | 13 +++++++++++-- layouts/index.html | 17 +++++++++-------- 3 files changed, 23 insertions(+), 13 deletions(-) diff --git a/hugo.toml b/hugo.toml index e73aba7..6dba8ba 100644 --- a/hugo.toml +++ b/hugo.toml @@ -15,7 +15,7 @@ disableKinds = ["taxonomy", "term", "RSS", "sitemap", "404"] blurb = "Classes, modules, inheritance, mutable method tables, `@ivars`, `new`/`initialize`, constants, `include` mixins, `super`, blocks & `yield`, `block_given?`, method_missing — the live object model that makes monkey-patching free." [[params.phases]] name = "Phase 2 — Core types & mixins" - status = "active" + status = "ready" blurb = "Integer (with **Bignum** promotion + arbitrary-precision literals, **radix literals** `0x`/`0o`/`0b`/`0d`, **bitwise/shift** `<< >> & | ^ ~`), Float, mutable String, Symbol (incl. **operator-method symbols** `:+`/`:<<`/`:[]=`), Array, ordered Hash, Range (incl. beginless/endless). Full argument system (optional/`*splat`/keyword/`**rest`/`&block`), Proc/lambda/stabby `->(){}`, `Symbol#to_proc`, class methods, `attr_accessor`, `Struct`. Comparable and Enumerable written once, in embedded Ruby." [[params.phases]] name = "Phase 3 — Control flow & Fiber" @@ -27,7 +27,7 @@ disableKinds = ["taxonomy", "term", "RSS", "sitemap", "404"] blurb = "`define_method`, `instance_eval`/`instance_exec`, `class_eval`/`module_eval`/`class_exec`, `send`/`public_send`, `respond_to?`, `instance_variable_get`/`set`/`defined?`, `tap`/`then`, the hooks `included`/`inherited`/`method_added`/`extended`, `define_singleton_method`/`extend` and `def obj.foo` syntax, **`@@class variables`**, **`$global variables`**, string `eval`, **`Binding`** (`binding`/`Binding#eval`/`eval(str, binding)` + `local_variable_get`/`set`/`local_variables`/`receiver` — eval against a captured frame's locals), and **`prepend`** with an ancestor-chain `super` (walks included/prepended modules and the singleton chain; `Module#ancestors`/`include?`, `Kernel` modelled)." [[params.phases]] name = "Phase 5 — Full front-end" - status = "active" + status = "ready" blurb = "Interpolation, keyword args, endless methods (`def foo = expr`), beginless/endless ranges, the stabby lambda, multiple assignment, full pattern matching `case/in` (value/bind/class/array/hash/find/pin/alternative, guards, one-line `=>`/`in`), safe navigation `&.`, numbered params (`_1`/`it`), modifier `rescue`, heredocs (`<<`/`<<-`/`<<~`, interpolating and literal), `%w`/`%i` arrays and the `%q`/`%Q`/`%W`/`%I` literals already landed." [[params.phases]] name = "Phase 6 — Standard library" @@ -40,4 +40,4 @@ disableKinds = ["taxonomy", "term", "RSS", "sitemap", "404"] [[params.phases]] name = "Phase 8 — Conformance & performance" status = "active" - blurb = "A conformance campaign brought the pure-Go **front-end** to ~**100% of all valid Ruby** parsed across Rails + Puppet (99.96% of files; 2 misses are syntax-error fixtures MRI rejects) and **parse + compile** of **Rails 99.82% / Puppet 100%**, with **0 over-permissive** — and RuboCop 99.7%, Sinatra/Jekyll/Thor/Kramdown/dry-struct 100%, RSpec DSL 10/10. On the runtime side, that road is now underway: **the real `puppet apply` CLI runs end-to-end** on a pure-Go CGO=0 `rbgo` — `require \"puppet\"` boots Puppet 8.11.0 (all pure-Ruby gem deps on the path), and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction/RAL) converges `notify`, `file` and `exec` resources (the `exec` provider runs commands via pure-Go process execution with `onlyif`/`unless`/`creates`/`path` guards), emits real Puppet output (`Notice: hi from rbgo cli`) and exits 0 with the YAML run report round-tripped. Broader resource **providers** are the active next milestone (`user`/`group` provider-ready; `package`/`service` need a host package manager/systemd + root). rbgo is also increasingly composed from the standalone pure-Go **go-ruby-* family** — **71 modules are now bound into rbgo as native modules** (parser, regexp, erb, marshal, yaml, format, optparse, strscan, json, set, date, … the full list is on the landing page), out of **104 CI-green family libraries** overall (binding the rest in progress), each its own 100%-coverage 6-arch org. Every one of the six arches is validated on **real hardware**, not just qemu — amd64/arm64 natively, riscv64/ppc64le/loong64 on the GCC Compile Farm (RVV, POWER8E/POWER9, LoongArch), s390x on the IBM LinuxONE Community Cloud — which is what makes the SIMD-accelerated modules and perf numbers measured rather than estimated. On performance, a 6-runtime suite (rbgo/rbgo+AOT vs MRI/YJIT/JRuby/TruffleRuby): **rbgo+AOT beats MRI+YJIT 18–24× on loop/fib**; plus inline method caches, small-integer interning (a small-int loop drops from ~245k allocations to 1) and capture-tracked frame recycling (~14% faster on fib)." + blurb = "Since July the work has been **runtime** conformance, measured against [ruby/spec](https://github.com/ruby/spec)'s `language/` + `core/` suites: **21,901 examples pass** (measured 2026-09-23 on `main`), gated in CI by a **shrink-only floor of 21,740** — the floor is the level CI refuses to fall below, raised deliberately after each wave, *not* the score. It has climbed from 6,000 when the ratchet landed on 2026-08-03, across 26 waves. Two of the recent jumps were fixes to the **measurement** rather than the interpreter — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — and those are gains in what the measurement can *see*, not in what the VM can *do*. Earlier, a conformance campaign brought the pure-Go **front-end** to ~**100% of all valid Ruby** parsed across Rails + Puppet (99.96% of files; 2 misses are syntax-error fixtures MRI rejects) and **parse + compile** of **Rails 99.82% / Puppet 100%**, with **0 over-permissive** — and RuboCop 99.7%, Sinatra/Jekyll/Thor/Kramdown/dry-struct 100%, RSpec DSL 10/10. On the runtime side, that road is now underway: **the real `puppet apply` CLI runs end-to-end** on a pure-Go CGO=0 `rbgo` — `require \"puppet\"` boots Puppet 8.11.0 (all pure-Ruby gem deps on the path), and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction/RAL) converges `notify`, `file` and `exec` resources (the `exec` provider runs commands via pure-Go process execution with `onlyif`/`unless`/`creates`/`path` guards), emits real Puppet output (`Notice: hi from rbgo cli`) and exits 0 with the YAML run report round-tripped. Broader resource **providers** are the active next milestone (`user`/`group` provider-ready; `package`/`service` need a host package manager/systemd + root). rbgo is also increasingly composed from the standalone pure-Go **go-ruby-* family** — **178 modules across 176 orgs are now bound into rbgo as native modules** (parser, regexp, erb, marshal, yaml, format, optparse, strscan, json, date, … a selection is on the landing page), each its own 100%-coverage 6-arch org. (`Set` is not among them: it is implemented in-tree, over rbgo's own Hash.) Every one of the six arches is validated on **real hardware**, not just qemu — amd64/arm64 natively, riscv64/ppc64le/loong64 on the GCC Compile Farm (RVV, POWER8E/POWER9, LoongArch), s390x on the IBM LinuxONE Community Cloud — which is what makes the SIMD-accelerated modules and perf numbers measured rather than estimated. On performance, a 6-runtime suite (rbgo/rbgo+AOT vs MRI/YJIT/JRuby/TruffleRuby): **rbgo+AOT beats MRI+YJIT 18–24× on loop/fib**; plus inline method caches, small-integer interning (a small-int loop drops from ~245k allocations to 1) and capture-tracked frame recycling (~14% faster on fib)." diff --git a/layouts/_default/list.html b/layouts/_default/list.html index 73b0495..d9d3069 100644 --- a/layouts/_default/list.html +++ b/layouts/_default/list.html @@ -67,8 +67,17 @@

C · Application conformance & performance

The pure-Go front-end and runtime, tested against real-world Ruby applications — parse, parse + compile, and end-to-end execution.

-

Front-end conformance

-

~100% of all valid Ruby parsed across Rails + Puppet — 99.96% of files; the 2 misses are syntax-error fixtures MRI itself rejects.

+

Runtime conformance — ruby/spec

+

21,901 examples pass in ruby/spec's language/ + core/ suites, measured 2026-09-23 on main.

+
    +
  • CI gates on a shrink-only floor of 21,740. The floor is the level a run may not fall below — it is not the score, and the measured total normally sits above it.
  • +
  • Of the examples that ran, 91.1% pass (21,901 of 24,044); 473 more are skipped and 15 of 2,206 spec files produce no result.
  • +
  • The floor has climbed from 6,000 on 2026-08-03 across 26 waves. Two recent jumps were fixes to the measurement — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — which are gains in what the measurement can see, not in what the VM can do.
  • +
+
+
+

Front-end conformance (measured 2026-06-27)

+

~100% of all valid Ruby parsed across Rails + Puppet — 99.96% of files; the 2 misses are syntax-error fixtures MRI itself rejects. Not re-measured since.

  • Parse + compile: Rails 99.82% / Puppet 100%, with 0 over-permissive.
  • RuboCop 99.7%.
  • diff --git a/layouts/index.html b/layouts/index.html index 9279205..5a411b2 100644 --- a/layouts/index.html +++ b/layouts/index.html @@ -24,7 +24,7 @@

    A complete Ruby,
    written in Go.< Get started → See the benchmarks

-
~100% of real Ruby parsed18–24× vs MRI+YJIT6 64-bit arches
+
21,901 ruby/spec examples passing~100% of real Ruby parsed6 64-bit arches
rbgo — zsh
@@ -37,15 +37,16 @@

A complete Ruby,
written in Go.< → app (CGO=0, 1 file, runs anywhere) # the real Puppet CLI, end to end -$ rbgo -e 'require "puppet"' apply site.pp +$ rbgo run puppet_apply.rb +Notice: Compiled catalog for in environment production in 0.00 seconds Notice: hi from rbgo cli -Applied catalog in 0.04s · exit 0 +Notice: /Stage[main]/Main/Notify[hello]/message: defined 'message'

- The go-ruby-* family — 184 standalone pure-Go modules — all CI-green, 100% coverage, 6-arch — all bound into rbgo. - + The go-ruby-* family — all CI-green, 100% coverage, 6-arch. 178 modules across 176 orgs are bound into rbgo today; a selection: +
@@ -56,7 +57,7 @@

Everything a Ruby runtime gives you — as a Go library.

🧩

Truly embeddable

A real object model — classes, mixins, method_missing, metaprogramming, Fiber — callable straight from Go.

📦

One static binary

CGO=0 by default. Cross-compiles to amd64, arm64, riscv64, loong64, ppc64le and s390x.

⚡

AOT that flies

Ahead-of-time method compilation to unboxed Go kernels — 18–24× over MRI+YJIT on loop/fib.

-
✅

Conformance-first

~100% of valid Ruby parsed across Rails + Puppet; parse+compile 99.82% / 100%, zero over-permissive.

+
✅

Conformance-first

21,901 ruby/spec language/ + core/ examples pass, gated in CI by a shrink-only floor of 21,740 — the floor is what CI refuses to fall below, not the score. Front-end: ~100% of valid Ruby parsed across Rails + Puppet (2026-06).

🔒

Closed-world builds

rbgo build --closed bakes the program to bytecode and drops the front-end for a smaller binary.

🌿

A real ecosystem

Built from the go-ruby-* family — each a 100%-coverage, 6-arch stdlib module, bound natively.

@@ -65,8 +66,8 @@

Everything a Ruby runtime gives you — as a Go library.

18–24×
rbgo+AOT vs MRI+YJIT (loop/fib)
-
~100%
valid Ruby parsed (Rails+Puppet)
-
184
pure-Go go-ruby-* modules
+
21,901
ruby/spec examples passing · CI floor 21,740
+
178
go-ruby-* modules bound into rbgo
CGO=0
across 6 arches · 3 OSes
From 7ead677f00f435578c8c5cf36c29b85f509848cb Mon Sep 17 00:00:00 2001 From: tannevaled Date: Wed, 23 Sep 2026 19:26:10 +0200 Subject: [PATCH 2/3] landing: re-measure against d498ddc after #629 merged #629 merged at 17:10Z, after the 68cb53a baseline this branch was written against. Re-measured on d498ddc: four consecutive ratchet runs, 21982, all four identical; detail sweep 21983 pass of 24044 examples that ran (91.4%), 473 skip, 15 of 2206 files producing no result. * hero trust line, stat tile, conformance card and hugo.toml: 21,901 -> 21,982 * /performance/ card: the pass rate, the run count, and d498ddc named * the floor is still 21740 on main; the page now names #638 (open, to 21970) rather than implying 21740 is permanent * 26 waves -> 27 Co-Authored-By: Claude Opus 5 --- hugo.toml | 2 +- layouts/_default/list.html | 8 ++++---- layouts/index.html | 6 +++--- 3 files changed, 8 insertions(+), 8 deletions(-) diff --git a/hugo.toml b/hugo.toml index 6dba8ba..7049c16 100644 --- a/hugo.toml +++ b/hugo.toml @@ -40,4 +40,4 @@ disableKinds = ["taxonomy", "term", "RSS", "sitemap", "404"] [[params.phases]] name = "Phase 8 — Conformance & performance" status = "active" - blurb = "Since July the work has been **runtime** conformance, measured against [ruby/spec](https://github.com/ruby/spec)'s `language/` + `core/` suites: **21,901 examples pass** (measured 2026-09-23 on `main`), gated in CI by a **shrink-only floor of 21,740** — the floor is the level CI refuses to fall below, raised deliberately after each wave, *not* the score. It has climbed from 6,000 when the ratchet landed on 2026-08-03, across 26 waves. Two of the recent jumps were fixes to the **measurement** rather than the interpreter — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — and those are gains in what the measurement can *see*, not in what the VM can *do*. Earlier, a conformance campaign brought the pure-Go **front-end** to ~**100% of all valid Ruby** parsed across Rails + Puppet (99.96% of files; 2 misses are syntax-error fixtures MRI rejects) and **parse + compile** of **Rails 99.82% / Puppet 100%**, with **0 over-permissive** — and RuboCop 99.7%, Sinatra/Jekyll/Thor/Kramdown/dry-struct 100%, RSpec DSL 10/10. On the runtime side, that road is now underway: **the real `puppet apply` CLI runs end-to-end** on a pure-Go CGO=0 `rbgo` — `require \"puppet\"` boots Puppet 8.11.0 (all pure-Ruby gem deps on the path), and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction/RAL) converges `notify`, `file` and `exec` resources (the `exec` provider runs commands via pure-Go process execution with `onlyif`/`unless`/`creates`/`path` guards), emits real Puppet output (`Notice: hi from rbgo cli`) and exits 0 with the YAML run report round-tripped. Broader resource **providers** are the active next milestone (`user`/`group` provider-ready; `package`/`service` need a host package manager/systemd + root). rbgo is also increasingly composed from the standalone pure-Go **go-ruby-* family** — **178 modules across 176 orgs are now bound into rbgo as native modules** (parser, regexp, erb, marshal, yaml, format, optparse, strscan, json, date, … a selection is on the landing page), each its own 100%-coverage 6-arch org. (`Set` is not among them: it is implemented in-tree, over rbgo's own Hash.) Every one of the six arches is validated on **real hardware**, not just qemu — amd64/arm64 natively, riscv64/ppc64le/loong64 on the GCC Compile Farm (RVV, POWER8E/POWER9, LoongArch), s390x on the IBM LinuxONE Community Cloud — which is what makes the SIMD-accelerated modules and perf numbers measured rather than estimated. On performance, a 6-runtime suite (rbgo/rbgo+AOT vs MRI/YJIT/JRuby/TruffleRuby): **rbgo+AOT beats MRI+YJIT 18–24× on loop/fib**; plus inline method caches, small-integer interning (a small-int loop drops from ~245k allocations to 1) and capture-tracked frame recycling (~14% faster on fib)." + blurb = "Since July the work has been **runtime** conformance, measured against [ruby/spec](https://github.com/ruby/spec)'s `language/` + `core/` suites: **21,982 examples pass** (measured 2026-09-23 on `main`, `d498ddc`, four consecutive runs all identical), gated in CI by a **shrink-only floor of 21,740** — the floor is the level CI refuses to fall below, raised deliberately after each wave, *not* the score. It has climbed from 6,000 when the ratchet landed on 2026-08-03, across 27 waves. Two of the recent jumps were fixes to the **measurement** rather than the interpreter — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — and those are gains in what the measurement can *see*, not in what the VM can *do*. Earlier, a conformance campaign brought the pure-Go **front-end** to ~**100% of all valid Ruby** parsed across Rails + Puppet (99.96% of files; 2 misses are syntax-error fixtures MRI rejects) and **parse + compile** of **Rails 99.82% / Puppet 100%**, with **0 over-permissive** — and RuboCop 99.7%, Sinatra/Jekyll/Thor/Kramdown/dry-struct 100%, RSpec DSL 10/10. On the runtime side, that road is now underway: **the real `puppet apply` CLI runs end-to-end** on a pure-Go CGO=0 `rbgo` — `require \"puppet\"` boots Puppet 8.11.0 (all pure-Ruby gem deps on the path), and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction/RAL) converges `notify`, `file` and `exec` resources (the `exec` provider runs commands via pure-Go process execution with `onlyif`/`unless`/`creates`/`path` guards), emits real Puppet output (`Notice: hi from rbgo cli`) and exits 0 with the YAML run report round-tripped. Broader resource **providers** are the active next milestone (`user`/`group` provider-ready; `package`/`service` need a host package manager/systemd + root). rbgo is also increasingly composed from the standalone pure-Go **go-ruby-* family** — **178 modules across 176 orgs are now bound into rbgo as native modules** (parser, regexp, erb, marshal, yaml, format, optparse, strscan, json, date, … a selection is on the landing page), each its own 100%-coverage 6-arch org. (`Set` is not among them: it is implemented in-tree, over rbgo's own Hash.) Every one of the six arches is validated on **real hardware**, not just qemu — amd64/arm64 natively, riscv64/ppc64le/loong64 on the GCC Compile Farm (RVV, POWER8E/POWER9, LoongArch), s390x on the IBM LinuxONE Community Cloud — which is what makes the SIMD-accelerated modules and perf numbers measured rather than estimated. On performance, a 6-runtime suite (rbgo/rbgo+AOT vs MRI/YJIT/JRuby/TruffleRuby): **rbgo+AOT beats MRI+YJIT 18–24× on loop/fib**; plus inline method caches, small-integer interning (a small-int loop drops from ~245k allocations to 1) and capture-tracked frame recycling (~14% faster on fib)." diff --git a/layouts/_default/list.html b/layouts/_default/list.html index d9d3069..883869c 100644 --- a/layouts/_default/list.html +++ b/layouts/_default/list.html @@ -68,11 +68,11 @@

C · Application conformance & performance

Runtime conformance — ruby/spec

-

21,901 examples pass in ruby/spec's language/ + core/ suites, measured 2026-09-23 on main.

+

21,982 examples pass in ruby/spec's language/ + core/ suites, measured 2026-09-23 on main (d498ddc), four consecutive runs all identical.

    -
  • CI gates on a shrink-only floor of 21,740. The floor is the level a run may not fall below — it is not the score, and the measured total normally sits above it.
  • -
  • Of the examples that ran, 91.1% pass (21,901 of 24,044); 473 more are skipped and 15 of 2,206 spec files produce no result.
  • -
  • The floor has climbed from 6,000 on 2026-08-03 across 26 waves. Two recent jumps were fixes to the measurement — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — which are gains in what the measurement can see, not in what the VM can do.
  • +
  • CI gates on a shrink-only floor of 21,740 (with #638 open to raise it to 21,970). The floor is the level a run may not fall below — it is not the score, and the measured total normally sits above it.
  • +
  • Of the examples that ran, 91.4% pass (21,983 of 24,044); 473 more are skipped and 15 of 2,206 spec files produce no result.
  • +
  • The floor has climbed from 6,000 on 2026-08-03 across 27 waves. Two recent jumps were fixes to the measurement — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — which are gains in what the measurement can see, not in what the VM can do.
diff --git a/layouts/index.html b/layouts/index.html index 5a411b2..b3c1126 100644 --- a/layouts/index.html +++ b/layouts/index.html @@ -24,7 +24,7 @@

A complete Ruby,
written in Go.< Get started → See the benchmarks

-
21,901 ruby/spec examples passing~100% of real Ruby parsed6 64-bit arches
+
21,982 ruby/spec examples passing~100% of real Ruby parsed6 64-bit arches
rbgo — zsh
@@ -57,7 +57,7 @@

Everything a Ruby runtime gives you — as a Go library.

🧩

Truly embeddable

A real object model — classes, mixins, method_missing, metaprogramming, Fiber — callable straight from Go.

📦

One static binary

CGO=0 by default. Cross-compiles to amd64, arm64, riscv64, loong64, ppc64le and s390x.

⚡

AOT that flies

Ahead-of-time method compilation to unboxed Go kernels — 18–24× over MRI+YJIT on loop/fib.

-
✅

Conformance-first

21,901 ruby/spec language/ + core/ examples pass, gated in CI by a shrink-only floor of 21,740 — the floor is what CI refuses to fall below, not the score. Front-end: ~100% of valid Ruby parsed across Rails + Puppet (2026-06).

+
✅

Conformance-first

21,982 ruby/spec language/ + core/ examples pass, gated in CI by a shrink-only floor of 21,740 — the floor is what CI refuses to fall below, not the score. Front-end: ~100% of valid Ruby parsed across Rails + Puppet (2026-06).

🔒

Closed-world builds

rbgo build --closed bakes the program to bytecode and drops the front-end for a smaller binary.

🌿

A real ecosystem

Built from the go-ruby-* family — each a 100%-coverage, 6-arch stdlib module, bound natively.

@@ -66,7 +66,7 @@

Everything a Ruby runtime gives you — as a Go library.

18–24×
rbgo+AOT vs MRI+YJIT (loop/fib)
-
21,901
ruby/spec examples passing · CI floor 21,740
+
21,982
ruby/spec examples passing · CI floor 21,740
178
go-ruby-* modules bound into rbgo
CGO=0
across 6 arches · 3 OSes
From 0d60a04fd397bc7c8171b273261e79af2c959f5e Mon Sep 17 00:00:00 2001 From: tannevaled Date: Wed, 23 Sep 2026 20:05:49 +0200 Subject: [PATCH 3/3] =?UTF-8?q?landing:=20the=20floor=20IS=2021,970=20?= =?UTF-8?q?=E2=80=94=20#638=20merged?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit #638 merged at 18:02Z; FLOOR on origin/main is 21970, re-read from the tree. The /performance/ bullet described it as an open PR. Swapped the number in three places, and added the reason the two figures are nearly equal, since a reader meeting "21,982 passing, floor 21,970" would otherwise wonder. Per #638, whose own numbers confirm the rule (lowest run 21981, floor 21970): the floor is set just under the lowest observed run -- wide enough for the #615 jitter, no wider, because a floor slack enough to hide the loss of a whole spec file would defeat what the ratchet exists to catch. The /performance/ climb bullet now names the endpoint (6,000 -> 21,970) rather than only the start. Co-Authored-By: Claude Opus 5 --- hugo.toml | 2 +- layouts/_default/list.html | 4 ++-- layouts/index.html | 4 ++-- 3 files changed, 5 insertions(+), 5 deletions(-) diff --git a/hugo.toml b/hugo.toml index 7049c16..a4c0927 100644 --- a/hugo.toml +++ b/hugo.toml @@ -40,4 +40,4 @@ disableKinds = ["taxonomy", "term", "RSS", "sitemap", "404"] [[params.phases]] name = "Phase 8 — Conformance & performance" status = "active" - blurb = "Since July the work has been **runtime** conformance, measured against [ruby/spec](https://github.com/ruby/spec)'s `language/` + `core/` suites: **21,982 examples pass** (measured 2026-09-23 on `main`, `d498ddc`, four consecutive runs all identical), gated in CI by a **shrink-only floor of 21,740** — the floor is the level CI refuses to fall below, raised deliberately after each wave, *not* the score. It has climbed from 6,000 when the ratchet landed on 2026-08-03, across 27 waves. Two of the recent jumps were fixes to the **measurement** rather than the interpreter — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — and those are gains in what the measurement can *see*, not in what the VM can *do*. Earlier, a conformance campaign brought the pure-Go **front-end** to ~**100% of all valid Ruby** parsed across Rails + Puppet (99.96% of files; 2 misses are syntax-error fixtures MRI rejects) and **parse + compile** of **Rails 99.82% / Puppet 100%**, with **0 over-permissive** — and RuboCop 99.7%, Sinatra/Jekyll/Thor/Kramdown/dry-struct 100%, RSpec DSL 10/10. On the runtime side, that road is now underway: **the real `puppet apply` CLI runs end-to-end** on a pure-Go CGO=0 `rbgo` — `require \"puppet\"` boots Puppet 8.11.0 (all pure-Ruby gem deps on the path), and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction/RAL) converges `notify`, `file` and `exec` resources (the `exec` provider runs commands via pure-Go process execution with `onlyif`/`unless`/`creates`/`path` guards), emits real Puppet output (`Notice: hi from rbgo cli`) and exits 0 with the YAML run report round-tripped. Broader resource **providers** are the active next milestone (`user`/`group` provider-ready; `package`/`service` need a host package manager/systemd + root). rbgo is also increasingly composed from the standalone pure-Go **go-ruby-* family** — **178 modules across 176 orgs are now bound into rbgo as native modules** (parser, regexp, erb, marshal, yaml, format, optparse, strscan, json, date, … a selection is on the landing page), each its own 100%-coverage 6-arch org. (`Set` is not among them: it is implemented in-tree, over rbgo's own Hash.) Every one of the six arches is validated on **real hardware**, not just qemu — amd64/arm64 natively, riscv64/ppc64le/loong64 on the GCC Compile Farm (RVV, POWER8E/POWER9, LoongArch), s390x on the IBM LinuxONE Community Cloud — which is what makes the SIMD-accelerated modules and perf numbers measured rather than estimated. On performance, a 6-runtime suite (rbgo/rbgo+AOT vs MRI/YJIT/JRuby/TruffleRuby): **rbgo+AOT beats MRI+YJIT 18–24× on loop/fib**; plus inline method caches, small-integer interning (a small-int loop drops from ~245k allocations to 1) and capture-tracked frame recycling (~14% faster on fib)." + blurb = "Since July the work has been **runtime** conformance, measured against [ruby/spec](https://github.com/ruby/spec)'s `language/` + `core/` suites: **21,982 examples pass** (measured 2026-09-23 on `main`, `d498ddc`, four consecutive runs all identical), gated in CI by a **shrink-only floor of 21,970** — the floor is the level CI refuses to fall below, *not* the score. It sits just under the measured total by design: a margin wide enough for the run-to-run jitter, narrow enough that losing a whole spec file still trips it. It has climbed from 6,000 when the ratchet landed on 2026-08-03, across 27 waves. Two of the recent jumps were fixes to the **measurement** rather than the interpreter — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — and those are gains in what the measurement can *see*, not in what the VM can *do*. Earlier, a conformance campaign brought the pure-Go **front-end** to ~**100% of all valid Ruby** parsed across Rails + Puppet (99.96% of files; 2 misses are syntax-error fixtures MRI rejects) and **parse + compile** of **Rails 99.82% / Puppet 100%**, with **0 over-permissive** — and RuboCop 99.7%, Sinatra/Jekyll/Thor/Kramdown/dry-struct 100%, RSpec DSL 10/10. On the runtime side, that road is now underway: **the real `puppet apply` CLI runs end-to-end** on a pure-Go CGO=0 `rbgo` — `require \"puppet\"` boots Puppet 8.11.0 (all pure-Ruby gem deps on the path), and the genuine `Puppet::Util::CommandLine` → `Puppet::Application::Apply` path (real `OptionParser`, all types + providers, settings catalog applied to disk, then the user catalog via the transaction/RAL) converges `notify`, `file` and `exec` resources (the `exec` provider runs commands via pure-Go process execution with `onlyif`/`unless`/`creates`/`path` guards), emits real Puppet output (`Notice: hi from rbgo cli`) and exits 0 with the YAML run report round-tripped. Broader resource **providers** are the active next milestone (`user`/`group` provider-ready; `package`/`service` need a host package manager/systemd + root). rbgo is also increasingly composed from the standalone pure-Go **go-ruby-* family** — **178 modules across 176 orgs are now bound into rbgo as native modules** (parser, regexp, erb, marshal, yaml, format, optparse, strscan, json, date, … a selection is on the landing page), each its own 100%-coverage 6-arch org. (`Set` is not among them: it is implemented in-tree, over rbgo's own Hash.) Every one of the six arches is validated on **real hardware**, not just qemu — amd64/arm64 natively, riscv64/ppc64le/loong64 on the GCC Compile Farm (RVV, POWER8E/POWER9, LoongArch), s390x on the IBM LinuxONE Community Cloud — which is what makes the SIMD-accelerated modules and perf numbers measured rather than estimated. On performance, a 6-runtime suite (rbgo/rbgo+AOT vs MRI/YJIT/JRuby/TruffleRuby): **rbgo+AOT beats MRI+YJIT 18–24× on loop/fib**; plus inline method caches, small-integer interning (a small-int loop drops from ~245k allocations to 1) and capture-tracked frame recycling (~14% faster on fib)." diff --git a/layouts/_default/list.html b/layouts/_default/list.html index 883869c..c5473bc 100644 --- a/layouts/_default/list.html +++ b/layouts/_default/list.html @@ -70,9 +70,9 @@

C · Application conformance & performance

Runtime conformance — ruby/spec

21,982 examples pass in ruby/spec's language/ + core/ suites, measured 2026-09-23 on main (d498ddc), four consecutive runs all identical.

    -
  • CI gates on a shrink-only floor of 21,740 (with #638 open to raise it to 21,970). The floor is the level a run may not fall below — it is not the score, and the measured total normally sits above it.
  • +
  • CI gates on a shrink-only floor of 21,970, raised there after wave 27. The floor is the level a run may not fall below — it is not the score. It sits just under the measured total on purpose: a margin of 12, wide enough to absorb the run-to-run jitter of #615 and no wider, because a floor slack enough to hide the loss of a whole spec file would defeat what the ratchet exists to catch.
  • Of the examples that ran, 91.4% pass (21,983 of 24,044); 473 more are skipped and 15 of 2,206 spec files produce no result.
  • -
  • The floor has climbed from 6,000 on 2026-08-03 across 27 waves. Two recent jumps were fixes to the measurement — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — which are gains in what the measurement can see, not in what the VM can do.
  • +
  • The floor has climbed from 6,000 on 2026-08-03 to 21,970 across 27 waves. Two recent jumps were fixes to the measurement — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — which are gains in what the measurement can see, not in what the VM can do.
diff --git a/layouts/index.html b/layouts/index.html index b3c1126..2bfb272 100644 --- a/layouts/index.html +++ b/layouts/index.html @@ -57,7 +57,7 @@

Everything a Ruby runtime gives you — as a Go library.

🧩

Truly embeddable

A real object model — classes, mixins, method_missing, metaprogramming, Fiber — callable straight from Go.

📦

One static binary

CGO=0 by default. Cross-compiles to amd64, arm64, riscv64, loong64, ppc64le and s390x.

⚡

AOT that flies

Ahead-of-time method compilation to unboxed Go kernels — 18–24× over MRI+YJIT on loop/fib.

-
✅

Conformance-first

21,982 ruby/spec language/ + core/ examples pass, gated in CI by a shrink-only floor of 21,740 — the floor is what CI refuses to fall below, not the score. Front-end: ~100% of valid Ruby parsed across Rails + Puppet (2026-06).

+
✅

Conformance-first

21,982 ruby/spec language/ + core/ examples pass, gated in CI by a shrink-only floor of 21,970 — the floor is what CI refuses to fall below, not the score. It sits just under the measured total by design: a margin wide enough for run-to-run jitter, narrow enough that losing a whole spec file still trips it. Front-end: ~100% of valid Ruby parsed across Rails + Puppet (2026-06).

🔒

Closed-world builds

rbgo build --closed bakes the program to bytecode and drops the front-end for a smaller binary.

🌿

A real ecosystem

Built from the go-ruby-* family — each a 100%-coverage, 6-arch stdlib module, bound natively.

@@ -66,7 +66,7 @@

Everything a Ruby runtime gives you — as a Go library.

18–24×
rbgo+AOT vs MRI+YJIT (loop/fib)
-
21,982
ruby/spec examples passing · CI floor 21,740
+
21,982
ruby/spec examples passing · CI floor 21,970
178
go-ruby-* modules bound into rbgo
CGO=0
across 6 arches · 3 OSes