Skip to content

fix(server): honor configured output default across APIs - #411

Open
earlvanze wants to merge 1 commit into
FlashML-org:mainfrom
earlvanze:fix/max-output-tokens-all-apis
Open

fix(server): honor configured output default across APIs#411
earlvanze wants to merge 1 commit into
FlashML-org:mainfrom
earlvanze:fix/max-output-tokens-all-apis

Conversation

@earlvanze

Copy link
Copy Markdown

Closes #395.

Threads the server-level --max-output-tokens fallback through the Chat Completions and Completions adapters, as the Responses adapter already does. Explicit request limits still take precedence; absent server configuration retains the 32k fallback.

Validation:

  • python3 -m py_compile for changed modules
  • git diff --check
  • Focused pytest suite is not runnable in this checkout because pytest/runtime dependencies are not installed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] --max-output-tokens is ignored by /v1/chat/completions and /v1/messages (only /v1/responses honours it)

1 participant