Skip to content

Commit 1b3181b

Browse files
author
Ronald Tse
committed
bench: E2 server-tier results — 4s cold loads, 2.5-3x faster decode than node tier
1 parent 1788b3b commit 1b3181b

1 file changed

Lines changed: 10 additions & 2 deletions

File tree

docs/RESULTS.md

Lines changed: 10 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -358,5 +358,13 @@ tiers x environments x metrics). First measurements, node tier
358358
Headline: **the integrity discipline is free** — whole-file sha256 is
359359
~0.1s against 7-13s session creation; the verified-index + cache-hit
360360
path is ~0.4s. int4 halves load time but decodes ~2.5x slower than
361-
int8; int8 is the client default. E2 (Modal 4-vCPU serving shape) and
362-
E3 (browser WASM/WebGPU) pending.
361+
int8; int8 is the client default. E2 (Modal 4-vCPU / 8 GiB — the production serving shape, 2026-08-29):
362+
363+
| tier | cold load (zip + verify + ORT) | decode short/med/long |
364+
|---|---|---|
365+
| tha-g2p-small-1.0 (257MB) | 3.92s | 130 / 409 / 671 ms |
366+
| ara-diac-small-1.0-int8 (257MB) | 4.04s | 395 / 525 / 973 ms |
367+
368+
Server vs node-laptop tier: cold load 4s vs 13s session create, decode
369+
~2.5-3x faster — the serving tier trades network for speed. E3 (browser
370+
WASM/WebGPU) pending.

0 commit comments

Comments
 (0)