Skip to content

add turboboost_tps param#230

Closed
zainhas wants to merge 1 commit intotogethercomputer:mainfrom
zainhas:lossy-spec-decoding
Closed

add turboboost_tps param#230
zainhas wants to merge 1 commit intotogethercomputer:mainfrom
zainhas:lossy-spec-decoding

Conversation

@zainhas
Copy link
Collaborator

@zainhas zainhas commented Jan 2, 2025

Add turboboost parameter to Python SDK to lossy speculative decoding support

@zainhas zainhas closed this Jan 2, 2025
@zainhas zainhas deleted the lossy-spec-decoding branch January 2, 2025 16:24
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant

Comments