From 1b3181baeae24e248eb7ebb8374d3ffa93e4bead Mon Sep 17 00:00:00 2001 From: Ronald Tse Date: Sat, 29 Aug 2026 19:14:49 +0800 Subject: [PATCH] =?UTF-8?q?bench:=20E2=20server-tier=20results=20=E2=80=94?= =?UTF-8?q?=204s=20cold=20loads,=202.5-3x=20faster=20decode=20than=20node?= =?UTF-8?q?=20tier?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- docs/RESULTS.md | 12 ++++++++++-- 1 file changed, 10 insertions(+), 2 deletions(-) diff --git a/docs/RESULTS.md b/docs/RESULTS.md index 9b16a18..4eb2eb4 100644 --- a/docs/RESULTS.md +++ b/docs/RESULTS.md @@ -358,5 +358,13 @@ tiers x environments x metrics). First measurements, node tier Headline: **the integrity discipline is free** — whole-file sha256 is ~0.1s against 7-13s session creation; the verified-index + cache-hit path is ~0.4s. int4 halves load time but decodes ~2.5x slower than -int8; int8 is the client default. E2 (Modal 4-vCPU serving shape) and -E3 (browser WASM/WebGPU) pending. +int8; int8 is the client default. E2 (Modal 4-vCPU / 8 GiB — the production serving shape, 2026-08-29): + +| tier | cold load (zip + verify + ORT) | decode short/med/long | +|---|---|---| +| tha-g2p-small-1.0 (257MB) | 3.92s | 130 / 409 / 671 ms | +| ara-diac-small-1.0-int8 (257MB) | 4.04s | 395 / 525 / 973 ms | + +Server vs node-laptop tier: cold load 4s vs 13s session create, decode +~2.5-3x faster — the serving tier trades network for speed. E3 (browser +WASM/WebGPU) pending.