Skip to content

Comments

Load LLMs in FP16 for Faster Inference#10

Open
Kyle1668 wants to merge 10 commits intomasterfrom
users/kyobrien/model-optim
Open

Load LLMs in FP16 for Faster Inference#10
Kyle1668 wants to merge 10 commits intomasterfrom
users/kyobrien/model-optim

Conversation

@Kyle1668
Copy link
Collaborator

@Kyle1668 Kyle1668 commented Jul 5, 2023

No description provided.

Copy link
Collaborator

@alvin319 alvin319 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm

Copy link
Member

@uSaiPrashanth uSaiPrashanth left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants