Skip to content

bench: E2 server-tier results - #87

Merged
ronaldtse merged 1 commit into
mainfrom
bench/e2
Aug 29, 2026
Merged

bench: E2 server-tier results#87
ronaldtse merged 1 commit into
mainfrom
bench/e2

Conversation

@ronaldtse

Copy link
Copy Markdown
Contributor

Modal 4-vCPU production shape: 3.9-4.0s cold load (zip + member verify + ORT), decodes 130-973ms by input length — 2.5-3x faster than the node-laptop tier. Completes the second cell of the paper-C matrix.

@ronaldtse
ronaldtse merged commit d0f2d9d into main Aug 29, 2026
11 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant