Skip to content

docs: sync the Benchmarks section with the 0.5.1 rerun - #50

Merged
only-cli merged 1 commit into
mainfrom
docs/benchmarks-0.5.1
Sep 2, 2026
Merged

docs: sync the Benchmarks section with the 0.5.1 rerun#50
only-cli merged 1 commit into
mainfrom
docs/benchmarks-0.5.1

Conversation

@only-cli

@only-cli only-cli commented Sep 2, 2026

Copy link
Copy Markdown
Owner

Updates the README's Benchmarks section to the 2026-09-02 rerun on oc 0.5.1 (only-cli/benchmarks#3). Prose and table changes only.

  • Headline: 125x fewer tokens than raw HTML on the twelve pages both read, 15x Jina Reader, 59x Playwright MCP.
  • Page view table: oc reads 13 of 15 pages for 8,971 tokens. Reddit now walls off logged-out readers and oc is the only reader that reports that instead of returning the wall. Yahoo Finance refuses plain fetch.
  • Agent tables: Wikipedia $0.23 against $0.35 and $0.45; language docs $0.56 against $0.71 and $0.85, all on claude-sonnet-5.
  • The Codex sentence now says which runs its figures come from, since those suites were not rerun.

Page view and Claude agent suites rerun on the published 0.5.1 on
2026-09-02. Reddit now sends logged-out readers to a login wall, so oc
reads 13 of 15 pages and says so on the other two; Yahoo Finance refuses
plain fetch. The Codex figures stay from the 0.4.0 and 0.5.0 runs and
are labelled that way.
@only-cli
only-cli merged commit e046d30 into main Sep 2, 2026
4 checks passed
@only-cli
only-cli deleted the docs/benchmarks-0.5.1 branch September 2, 2026 21:06
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant