Skip to content

fix(_internals): use n_tokens0 offset when enabling last-token logits in add_sequence#2205

Merged
abetlen merged 3 commits into
abetlen:mainfrom
Anai-Guo:fix-add-sequence-logits-index
May 4, 2026
Merged

fix(_internals): use n_tokens0 offset when enabling last-token logits in add_sequence#2205
abetlen merged 3 commits into
abetlen:mainfrom
Anai-Guo:fix-add-sequence-logits-index

test: cover batched embedding reuse semantics

051ecf9
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs