File tree Expand file tree Collapse file tree
Expand file tree Collapse file tree Original file line number Diff line number Diff line change @@ -358,5 +358,13 @@ tiers x environments x metrics). First measurements, node tier
358358Headline: ** the integrity discipline is free** — whole-file sha256 is
359359~ 0.1s against 7-13s session creation; the verified-index + cache-hit
360360path is ~ 0.4s. int4 halves load time but decodes ~ 2.5x slower than
361- int8; int8 is the client default. E2 (Modal 4-vCPU serving shape) and
362- E3 (browser WASM/WebGPU) pending.
361+ int8; int8 is the client default. E2 (Modal 4-vCPU / 8 GiB — the production serving shape, 2026-08-29):
362+
363+ | tier | cold load (zip + verify + ORT) | decode short/med/long |
364+ | ---| ---| ---|
365+ | tha-g2p-small-1.0 (257MB) | 3.92s | 130 / 409 / 671 ms |
366+ | ara-diac-small-1.0-int8 (257MB) | 4.04s | 395 / 525 / 973 ms |
367+
368+ Server vs node-laptop tier: cold load 4s vs 13s session create, decode
369+ ~ 2.5-3x faster — the serving tier trades network for speed. E3 (browser
370+ WASM/WebGPU) pending.
You can’t perform that action at this time.
0 commit comments