Skip to content

Commit 8b55165

Browse files
delavetdelavet
committed
(helm) support custom volumes and volumeMounts for epp
Signed-off-by: Hang Yin <luying.yh@alibaba-inc.com>
1 parent cbbfd0e commit 8b55165

File tree

3 files changed

+22
-1
lines changed

3 files changed

+22
-1
lines changed

‎config/charts/inferencepool/README.md‎

Lines changed: 15 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -247,6 +247,21 @@ The following table list the configurable parameters of the chart.
247247
| `inferenceExtension.tracing.otelExporterEndpoint` | OpenTelemetry collector endpoint. |
248248
| `inferenceExtension.tracing.sampling.sampler` | The trace sampler to use. Currently, only `parentbased_traceidratio` is supported. This sampler respects the parent span’s sampling decision when present, and applies the configured ratio for root spans. |
249249
| `inferenceExtension.tracing.sampling.samplerArg` | Sampler-specific argument. For `parentbased_traceidratio`, this defines the base sampling rate for new traces (root spans), as a float string in the range [0.0, 1.0]. For example, "0.1" enables 10% sampling. |
250+
| `inferenceExtension.volumes` | List of volumes to mount in the EPP deployment as free-form YAML. Optional. |
251+
| `inferenceExtension.volumeMounts` | List of volume mounts for the EPP container as free-form YAML. Optional. |
252+
| `inferenceExtension.sidecar.enabled` | Enables or disables the sidecar container in the EPP deployment. Defaults to `false`. |
253+
| `inferenceExtension.sidecar.name` | Name of the sidecar container. Required when the sidecar is enabled. |
254+
| `inferenceExtension.sidecar.image` | Image for the sidecar container. Required when the sidecar is enabled. |
255+
| `inferenceExtension.sidecar.imagePullPolicy` | Image pull policy for the sidecar container. Possible values: `Always`, `IfNotPresent`, or `Never`. Defaults to `IfNotPresent`. |
256+
| `inferenceExtension.sidecar.command` | Command to run in the sidecar container as a single string. Optional. |
257+
| `inferenceExtension.sidecar.args` | Arguments to pass to the command in the sidecar container as a list of strings. Optional. |
258+
| `inferenceExtension.sidecar.env` | Environment variables to set in the sidecar container as free-form YAML. Optional. |
259+
| `inferenceExtension.sidecar.ports` | List of ports to expose for the sidecar container. Optional. |
260+
| `inferenceExtension.sidecar.livenessProbe` | Liveness probe configuration for the sidecar container. Optional. |
261+
| `inferenceExtension.sidecar.readinessProbe` | Readiness probe configuration for the sidecar container. Optional. |
262+
| `inferenceExtension.sidecar.resources` | Resource limits and requests for the sidecar container. Optional. |
263+
| `inferenceExtension.sidecar.volumeMounts` | List of volume mounts for the sidecar container. Optional. |
264+
| `inferenceExtension.sidecar.volumes` | List of volumes for the sidecar container. Optional. |
250265
| `provider.name` | Name of the Inference Gateway implementation being used. Possible values: [`none`, `gke`, or `istio`]. Defaults to `none`. |
251266
| `provider.gke.autopilot` | Set to `true` if the cluster is a GKE Autopilot cluster. This is only used if `provider.name` is `gke`. Defaults to `false`. |
252267

‎config/charts/inferencepool/templates/epp-config.yaml‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -64,7 +64,7 @@ data:
6464
{{- end }}
6565

6666
---
67-
{{- if .Values.inferenceExtension.sidecar.enabled }}
67+
{{- if and .Values.inferenceExtension.sidecar.enabled .Values.inferenceExtension.sidecar.configMap }}
6868
apiVersion: v1
6969
kind: ConfigMap
7070
metadata:

‎config/charts/inferencepool/templates/epp-deployment.yaml‎

Lines changed: 6 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -182,8 +182,14 @@ spec:
182182
volumeMounts:
183183
- name: plugins-config-volume
184184
mountPath: "/config"
185+
{{- if .Values.inferenceExtension.volumeMounts }}
186+
{{- tpl (toYaml .Values.inferenceExtension.volumeMounts) $ | nindent 8 }}
187+
{{- end }}
185188
{{- include "gateway-api-inference-extension.latencyPredictor.containers" . | nindent 6 }}
186189
volumes:
190+
{{- if .Values.inferenceExtension.volumes }}
191+
{{- tpl (toYaml .Values.inferenceExtension.volumes) $ | nindent 6 }}
192+
{{- end }}
187193
{{- if .Values.inferenceExtension.sidecar.volumes }}
188194
{{- tpl (toYaml .Values.inferenceExtension.sidecar.volumes) $ | nindent 6 }}
189195
{{- end }}

0 commit comments

Comments
 (0)