Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension


Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
34 changes: 34 additions & 0 deletions .github/workflows/deploy-pages.yml
Original file line number Diff line number Diff line change
Expand Up @@ -46,6 +46,40 @@ jobs:
id: pages
uses: actions/configure-pages@v6

# This page states rbgo's ruby/spec total in the present tense in four
# places, and on 2026-10-12 all of them said 22,488 while the gate's own
# file summed to 23,511 — and two of them described the gate as a
# "shrink-only floor of 22,475", a mechanism replaced by a per-file
# baseline in ruby#739. A number and a mechanism, both stale, on the first
# page anybody reads.
#
# The check sums the gate's own per-file baseline and compares it against
# every present-tense claim here. It is the same binary the docs site
# runs, consumed across repositories rather than copied: two readers of
# one file cannot drift, where two transcriptions of one number already
# had. A dated block ("measured <date>") is exempt, because a dated
# measurement going stale is not an error.
#
# It runs BEFORE hugo so a wrong figure fails the build instead of being
# published, and on pull requests as well as on main. An unreachable
# baseline exits 2 and fails the step: an unreadable baseline finds no
# disagreement either, and that silence would read as agreement.
#
# PINNED TO A TAG, not @main, and that is not tidiness. `@main` is not
# "the current main": it is whatever the module proxy last cached for the
# branch, and the lag is measurable --
#
# $ go list -m github.com/go-embedded-ruby/docs@main
# …v0.0.0-20261012071659-5a27ddae9f8d # 07:16:59
# $ gh api …/commits/main --jq .sha
# 3384011416dc… # 07:25:48
#
# The first version of this step used @main and failed on a branch whose
# figures were right, because the tool it ran was nine minutes old and
# could not yet see this page's phrasing. A tag resolves deterministically.
- name: The stated conformance total matches rbgo's gate
run: go run github.com/go-embedded-ruby/docs/tools/conformancefigure@v0.1.0 -root layouts

- name: Build landing page
run: hugo --minify --baseURL "${{ steps.pages.outputs.base_url }}/"

Expand Down
4 changes: 2 additions & 2 deletions layouts/_default/list.html
Original file line number Diff line number Diff line change
Expand Up @@ -70,10 +70,10 @@ <h2>C · Application conformance &amp; performance</h2>
<h3>Runtime conformance — ruby/spec</h3>
<p><b>22,488 examples pass</b> in ruby/spec's <code>language/</code> + <code>core/</code> suites, measured 2026-09-26 on <code>main</code> (<code>3e8e3cc</code>). Three independent runs — two through the ratchet at different timeouts, one through a separate sweep — reported the same total.</p>
<ul>
<li>CI gates on a <b>shrink-only floor of 22,475</b>. The floor is the level a run may not fall below — it is <b>not</b> the score: it is what CI guarantees, while the measured total is what one run did.</li>
<li>CI gates <b>file by file</b>, not on a total: no spec file may pass fewer examples than its recorded row, and none may stop loading. The sum of those rows is <b>23,511</b> at rbgo v0.3.0 (2026-10-12) — it is what CI guarantees, while the measured total above is what one dated run did. This replaced a single shrink-only floor of 22,475, which needed a margin wider than the largest spec file and so could not see a regression smaller than that.</li>
<li><b>Only <code>language/</code> and <code>core/</code> are swept.</b> ruby/spec's <code>library/</code>, <code>optional/</code> and <code>security/</code> trees are not run at all, so this figure is <b>not</b> a percentage of Ruby, and most of the standard library sits outside it.</li>
<li>Of the examples that ran, <b>93.3%</b> pass (22,488 of 24,116); 477 more are skipped because our shim stubs the matcher they need, and 10 of 2,206 spec files produce no result. Skips and unreadable files sit outside the ratio entirely.</li>
<li>The floor has climbed from <b>6,000</b> on 2026-08-03 to <b>22,475</b>. Two earlier jumps were fixes to the <b>measurement</b> — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — which are gains in what the measurement can <i>see</i>, not in what the VM can <i>do</i>.</li>
<li>The guarantee has climbed from a floor of <b>6,000</b> on 2026-08-03 to a per-file baseline summing <b>23,511</b>. Two earlier jumps were fixes to the <b>measurement</b> — the mspec shim, and a parser upgrade that made 13 previously-unparseable spec files visible — which are gains in what the measurement can <i>see</i>, not in what the VM can <i>do</i>.</li>
</ul>
</div>
<div class="appcard">
Expand Down
6 changes: 3 additions & 3 deletions layouts/index.html
Original file line number Diff line number Diff line change
Expand Up @@ -24,7 +24,7 @@ <h1 class="head">A Ruby you can embed,<br><span class="accent">written in Go.</s
<a class="btn btn-primary" href="https://github.com/go-embedded-ruby/ruby">{{ partial "icons/rocket.html" . }}Get started →</a>
<a class="btn btn-ghost" href="/performance/">{{ partial "icons/graph.html" . }}See the benchmarks</a>
</div>
<div class="trust"><span><b>22,488</b> ruby/spec <code>language/</code>+<code>core/</code> examples passing</span><span><b>~100%</b> of real Ruby parsed</span><span><b>6</b> 64-bit arches</span></div>
<div class="trust"><span><b>23,511</b> ruby/spec <code>language/</code>+<code>core/</code> examples passing</span><span><b>~100%</b> of real Ruby parsed</span><span><b>6</b> 64-bit arches</span></div>
</div>
<div class="term">
<div class="bar"><i style="background:#ff5f57"></i><i style="background:#febc2e"></i><i style="background:#28c840"></i><span class="t">rbgo — zsh</span></div>
Expand Down Expand Up @@ -59,7 +59,7 @@ <h2>Everything a Ruby runtime gives you — as a Go library.</h2>
<div class="card"><div class="ico">🧩</div><h3>Embeddable</h3><p>A real object model — classes, mixins, <code>method_missing</code>, metaprogramming, Fiber. The Go API is deliberately small today: <code>ruby.Run(src, out)</code> runs a program on a fresh VM and writes its output to one writer. Calling a Ruby method from Go is not exposed yet.</p></div>
<div class="card"><div class="ico">📦</div><h3>One static binary</h3><p>CGO=0 by default. Cross-compiles to amd64, arm64, riscv64, loong64, ppc64le and s390x.</p></div>
<div class="card"><div class="ico">⚡</div><h3>AOT for integer kernels</h3><p>Ahead-of-time compilation of integer-bound methods to unboxed Go. Measured on this project’s own micro-benchmarks (darwin/arm64, whole-process wall time): <b>8.7×</b> MRI+YJIT on the tight-loop case, <b>2.0×</b> on recursive <code>fib(35)</code>. Only methods the compiler can lower benefit.</p></div>
<div class="card"><div class="ico">✅</div><h3>Conformance, measured</h3><p><b>22,488</b> ruby/spec <code>language/</code> + <code>core/</code> examples pass, gated in CI by a shrink-only floor of <b>22,475</b> — the floor is what CI refuses to fall below, not the score. <b>Only <code>language/</code> and <code>core/</code> are swept:</b> <code>library/</code>, <code>optional/</code> and <code>security/</code> are not run, so this is not a percentage of Ruby. Front-end: ~100% of valid Ruby parsed across Rails + Puppet (2026-06).</p></div>
<div class="card"><div class="ico">✅</div><h3>Conformance, measured</h3><p><b>23,511</b> ruby/spec <code>language/</code> + <code>core/</code> examples pass, gated in CI <b>file by file</b>: no spec file may pass fewer examples than its recorded row, so a regression is named rather than absorbed in a total. <b>Only <code>language/</code> and <code>core/</code> are swept:</b> <code>library/</code>, <code>optional/</code> and <code>security/</code> are not run, so this is not a percentage of Ruby. Front-end: ~100% of valid Ruby parsed across Rails + Puppet (2026-06).</p></div>
<div class="card"><div class="ico">🔒</div><h3>Closed-world builds</h3><p><code>rbgo build --closed</code> bakes the program to bytecode and drops the front-end for a smaller binary.</p></div>
<div class="card"><div class="ico">🌿</div><h3>A real ecosystem</h3><p>Built from the <b>go-ruby-*</b> family — each a 100%-coverage, 6-arch stdlib module, bound natively.</p></div>
</div>
Expand All @@ -68,7 +68,7 @@ <h2>Everything a Ruby runtime gives you — as a Go library.</h2>
<section id="perf" style="padding-top:10px"><div class="wrap">
<div class="stats">
<div><div class="n">8.7×</div><div class="l">rbgo+AOT vs MRI+YJIT, tight-loop benchmark (2.0× on <code>fib(35)</code>)</div></div>
<div><div class="n">22,488</div><div class="l">ruby/spec <code>language/</code>+<code>core/</code> examples passing · CI floor 22,475</div></div>
<div><div class="n">23,511</div><div class="l">ruby/spec <code>language/</code>+<code>core/</code> examples passing · gated per file, not by a total</div></div>
<div><div class="n">178</div><div class="l">go-ruby-* modules bound into rbgo</div></div>
<div><div class="n">CGO=0</div><div class="l">across 6 arches · 3 OSes</div></div>
</div>
Expand Down
Loading