Skip to content

Commit 6f6702d

Browse files
authored
add default for vllm envs (#18)
Signed-off-by: Jordan Dubrick <jdubrick@redhat.com>
1 parent 05676b3 commit 6f6702d

1 file changed

Lines changed: 2 additions & 2 deletions

File tree

run.yaml

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -70,8 +70,8 @@ providers:
7070
- provider_id: ${env.ENABLE_VLLM:+vllm}
7171
provider_type: remote::vllm
7272
config:
73-
url: ${env.VLLM_URL}
74-
api_token: ${env.VLLM_API_KEY}
73+
url: ${env.VLLM_URL:=}
74+
api_token: ${env.VLLM_API_KEY:=}
7575
max_tokens: ${env.VLLM_MAX_TOKENS:=4096}
7676
tls_verify: ${env.VLLM_TLS_VERIFY:=true}
7777
- provider_id: ${env.ENABLE_OLLAMA:+ollama}

0 commit comments

Comments
 (0)