Skip to content
Draft
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
5 changes: 5 additions & 0 deletions config/_default/menus/main.en.yaml
Original file line number Diff line number Diff line change
Expand Up @@ -5398,6 +5398,11 @@ menu:
identifier: data_observability_cicd
parent: data_observability_heading
weight: 90000
- name: Optimize
url: data_observability/optimize/
identifier: data_observability_optimize
parent: data_observability_heading
weight: 100000
- name: Databricks
url: data_observability/jobs_monitoring/databricks
identifier: jobs_monitoring_databricks
Expand Down
4 changes: 4 additions & 0 deletions content/en/data_observability/_index.md
Original file line number Diff line number Diff line change
Expand Up @@ -17,6 +17,9 @@ further_reading:
- link: '/data_observability/cicd/'
tag: 'Documentation'
text: 'CI/CD'
- link: '/data_observability/optimize/'
tag: 'Documentation'
text: 'Optimize'
- link: 'https://www.datadoghq.com/about/latest-news/press-releases/datadog-metaplane-aquistion/'
tag: 'Blog'
text: 'Datadog Brings Observability to Data teams by Acquiring Metaplane'
Expand All @@ -42,4 +45,5 @@ Data Observability (DO) helps data teams improve the reliability of data for ana
{{< nextlink href="/data_observability/quality_monitoring/" >}}Quality Monitoring: Identify data issues before downstream BI and AI applications are impacted.{{< /nextlink >}}
{{< nextlink href="/data_observability/jobs_monitoring/" >}}Jobs Monitoring: Observe, troubleshoot, and optimize jobs across your data pipelines.{{< /nextlink >}}
{{< nextlink href="/data_observability/cicd/" >}}CI/CD: Prevent data-quality issues before they're merged.{{< /nextlink >}}
{{< nextlink href="/data_observability/optimize/" >}}Optimize: Get recommendations to reduce cost and improve performance of jobs and queries.{{< /nextlink >}}
{{< /whatsnext >}}
38 changes: 38 additions & 0 deletions content/en/data_observability/optimize.md
Original file line number Diff line number Diff line change
@@ -0,0 +1,38 @@
---
title: Optimize
description: Get recommendations to reduce the cost and improve the performance of Spark and Databricks jobs, and Snowflake, BigQuery, and Trino queries.
further_reading:
- link: '/data_observability/'
tag: 'Documentation'
text: 'Data Observability Overview'
- link: '/data_observability/jobs_monitoring/'
tag: 'Documentation'
text: 'Jobs Monitoring'
---

<div class="alert alert-info">Optimization recommendations are in preview. Contact your Datadog representative or <a href="/help/">support</a> to request access.</div>

## Overview

Data Observability analyzes your Spark and Databricks jobs, and your Snowflake, BigQuery, and Trino queries, to surface specific recommendations for reducing cost and improving performance — for example, right-sizing cluster configuration or rewriting an inefficient query.

Each recommendation includes an estimated cost or duration impact. Some job recommendations can be applied directly as a code change through Bits AI.

## View recommendations

Recommendations for jobs and clusters appear inline in [Jobs Monitoring][1] job and cluster tables. Select a job or cluster with an available recommendation to open its recommendation details in a side panel.

Each recommendation has a status you can update as you triage it:

| Status | Description |
|---|---|
| {{< ui >}}For Review{{< /ui >}} | The default status for a new recommendation. |
| {{< ui >}}Reviewed{{< /ui >}} | You've looked at the recommendation but haven't acted on it yet. |
| {{< ui >}}Ignored{{< /ui >}} | You've decided not to act on this recommendation. |
| {{< ui >}}Resolved{{< /ui >}} | You've applied the recommendation. |

For recommendations that include a code change, click {{< ui >}}Fix with Bits{{< /ui >}} to have Bits AI apply the change for you.

**Note**: Whether Data Observability generates recommendations for your Snowflake, BigQuery, Databricks, or Trino workloads depends on which recommenders your organization has enabled — contact your Datadog representative to confirm which are active for your account.

[1]: /data_observability/jobs_monitoring/
Loading