Skip to content

Fix create_completion capping all batch prompts to the shortest context's max_tokens#3867

Closed
Chessing234 wants to merge 1 commit into
lm-sys:mainfrom
Chessing234:fix/completion-max-tokens-shared-across-prompts
Closed

Fix create_completion capping all batch prompts to the shortest context's max_tokens#3867
Chessing234 wants to merge 1 commit into
lm-sys:mainfrom
Chessing234:fix/completion-max-tokens-shared-across-prompts

Fix create_completion reducing request.max_tokens for all prompts via…

936415d
Select commit
Loading
Failed to load commit list.
Sign in for the full log view

Annotations

1 warning
build (3.10)
succeeded May 9, 2026 in 51s