Skip to content
Merged
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
17 changes: 12 additions & 5 deletions content/en/data_observability/jobs_monitoring/kubernetes.md
Original file line number Diff line number Diff line change
Expand Up @@ -167,10 +167,11 @@ features:
apm:
instrumentation:
enabled: true
enabledNamespaces:
- <NAMESPACE> # namespace where your Spark jobs run
targets:
- name: spark-driver
namespaceSelector:
matchNames:
- <NAMESPACE> # namespace where your Spark jobs run
podSelector:
matchLabels:
spark-role: driver # replace with your submitter pod labels if running in client mode
Expand All @@ -180,6 +181,9 @@ features:
- name: DD_DATA_JOBS_ENABLED
value: "true"
- name: spark-executor
namespaceSelector:
matchNames:
- <NAMESPACE>
podSelector:
matchLabels:
spark-role: executor
Expand All @@ -206,10 +210,11 @@ datadog:
apm:
instrumentation:
enabled: true
enabledNamespaces:
- <NAMESPACE> # namespace where your Spark jobs run
targets:
- name: spark-driver
namespaceSelector:
matchNames:
- <NAMESPACE> # namespace where your Spark jobs run
podSelector:
matchLabels:
spark-role: driver # replace with your submitter pod labels if running in client mode
Expand All @@ -219,6 +224,9 @@ datadog:
- name: DD_DATA_JOBS_ENABLED
value: "true"
- name: spark-executor
namespaceSelector:
matchNames:
- <NAMESPACE>
podSelector:
matchLabels:
spark-role: executor
Expand All @@ -238,7 +246,6 @@ helm upgrade <RELEASE_NAME> datadog/datadog -f datadog-values.yaml

After applying the configuration, restart the targeted pods. SSI injects the init container into each pod on startup.


## Validation

In Datadog, view the [Data Observability: Jobs Monitoring][5] page to see a list of all your data processing jobs.
Expand Down
Loading