Skip to content

docs(models): document the reasoning-only stream limit - #94

Merged
sre-helmcode merged 1 commit into
mainfrom
docs/reasoning-only-stream-limit
Sep 22, 2026
Merged

sre-helmcode merged 1 commit into
mainfrom
docs/reasoning-only-stream-limit

Conversation

@sre-helmcode

Copy link
Copy Markdown
Contributor

What

Documents the platform-side reasoning-only stream limit in the public
model docs (EN + ES mirrors), in the same section as the
reasoning_effort contract:

  • 60,000 reasoning characters (≈15k tokens) or 420 seconds with
    no visible content / tool calls → the platform closes the turn with
    finish_reason: "length".
  • The closing stream carries an estimated usage chunk when
    stream_options.include_usage is set: estimated: true, billed: false + nan_truncation marker (shipped in nan-devops#550,
    deployed 2026-09-21).
  • Disarm-on-first-output behavior and the member-actionable mitigation
    levers (reasoning_effort, early-content prompt design).

Why

Issue #90: the limit was enforced but undeclared — the exact class of
published-vs-enforced disagreement tracked in #53. Members bisecting
long-reasoning prompts had no way to know the ceiling was ours, and the
missing usage block made attempts unaccountable.

Evidence

  • npm run build green (Astro/Vite, both locales).
  • Content cross-checked against the deployed hook defaults (420s / 60,000
    chars, no env overrides in the cluster) and the live trip verified
    2026-09-21 (glm5.3-flash, 164s, estimated usage chunk observed).

Publishes the platform-side limit that closes reasoning-only streams
(issue #90 follow-up, alongside the estimated usage chunk shipped in
nan-devops#550): 60,000 reasoning characters or 420 seconds with no
visible output, closed with finish_reason=length plus an estimated,
not-billed usage chunk when include_usage was requested. Sits in the
same section as the reasoning_effort contract, EN + ES mirrors, with
the disarm-on-first-output behavior and the mitigation levers members
can act on.
@sre-helmcode
sre-helmcode merged commit 66917e4 into main Sep 22, 2026
2 checks passed
@sre-helmcode
sre-helmcode deleted the docs/reasoning-only-stream-limit branch September 22, 2026 12:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants