Skip to content

[Enhancement] Expose inference speed metrics for Chat and Completion#399

Open
cch1rag wants to merge 1 commit into
undreamai:mainfrom
cch1rag:enhancement/expose-inference-speed
Open

[Enhancement] Expose inference speed metrics for Chat and Completion#399
cch1rag wants to merge 1 commit into
undreamai:mainfrom
cch1rag:enhancement/expose-inference-speed

Expose inference speed metrics on LLMClient

2b43e19
Select commit
Loading
Failed to load commit list.

Workflow runs completed with no jobs