Replies: 1 comment
-
|
The answer is "hidden" in https://github.com/openvinotoolkit/model_server/blob/main/docs/llm/reference.md |
Beta Was this translation helpful? Give feedback.
0 replies
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Uh oh!
There was an error while loading. Please reload this page.
-
Currently "--tool_parsers" is accepted at the docker command, but if I want a single docker to server multiple llm's then this forces me to have multiple docker instances per llm.
Is there any other place where this param could be set ? and allow a single docker instance server multiple llm's ?
Beta Was this translation helpful? Give feedback.
All reactions