Skip to content
Merged
Show file tree
Hide file tree
Changes from all commits
Commits
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Amazon OpenSearch Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Amazon OpenSearch destination to send logs to Amazon OpenSearch.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Amazon S3 Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use the Amazon S3 destination to send logs to Amazon S3. If you want to send logs to Amazon S3 for [archiving][1] and [rehydration][2], you must [configure Log Archives](#configure-log-archives). If you don't want to rehydrate your logs in Datadog, skip to [Set up the destination for your pipeline](#set-up-the-destination-for-your-pipeline).

You can also [route logs to Snowflake using the Amazon S3 destination](#route-logs-to-snowflake-using-the-amazon-s3-destination).
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Amazon Security Lake Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Amazon Security Lake destination to send logs to Amazon Security Lake.

## Prerequisites
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Azure Storage Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use the Azure Storage destination to send logs to an Azure Storage bucket. If you want to send logs to Azure Storage for [archiving][1] and [rehydration][2], you must [configure Log Archives](#configure-log-archives). If you don't want to rehydrate logs in Datadog, skip to [Set up the destination for your pipeline](#set-up-the-destination-for-your-pipeline).

## Configure Log Archives
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Datadog CloudPrem Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' CloudPrem destination to send logs to Datadog CloudPrem.


Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: CrowdStrike Next-Gen SIEM Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' CrowdStrike Next-Gen SIEM destination to send logs to CrowdStrike Next-Gen SIEM.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Datadog Logs Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Datadog Logs destination to send logs to Datadog Log Management. You can also use [AWS PrivateLink](#aws-privatelink) to send logs from Observability Pipelines to Datadog.

## Setup
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -2,8 +2,13 @@
title: Datadog Metrics
description: Learn how to set up the Datadog Metrics destination.
disable_toc: false
products:
- name: Metrics
icon: metrics
---

{{< product-availability >}}

Use Observability Pipelines' Datadog Metrics destination to send metrics to Datadog. You can also use [AWS PrivateLink](#aws-privatelink) to send metrics from Observability Pipelines to Datadog.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Elasticsearch Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Elasticsearch destination to send logs to Elasticsearch.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,7 +1,13 @@
---
title: Google Chronicle Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Google Chronicle destination to send logs to Google Chronicle.

The Observability Pipelines Worker uses standard Google authentication methods. See [Authentication methods at Google][3] for more information about choosing the authentication method for your use case.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,9 +1,14 @@
---
title: Google Cloud Storage Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

<div class="alert alert-danger">For Worker versions 2.7 and later, the Google Cloud destination supports <a href = "https://cloud.google.com/storage/docs/uniform-bucket-level-access">uniform bucket-level access</a>. Google <a href = "https://cloud.google.com/storage/docs/uniform-bucket-level-access#should-you-use">recommends</a> using uniform bucket-level access. <br>For Worker version older than 2.7, only <a href = "https://cloud.google.com/storage/docs/access-control/lists">Access Control Lists</a> is supported.</div>
{{< product-availability >}}

<div class="alert alert-info">For Worker versions 2.7 and later, the Google Cloud destination supports <a href = "https://cloud.google.com/storage/docs/uniform-bucket-level-access">uniform bucket-level access</a>. Google <a href = "https://cloud.google.com/storage/docs/uniform-bucket-level-access#should-you-use">recommends</a> using uniform bucket-level access. <br>For Worker version older than 2.7, only <a href = "https://cloud.google.com/storage/docs/access-control/lists">Access Control Lists</a> is supported.</div>

Use the Google Cloud Storage destination to send your logs to a Google Cloud Storage bucket. If you want to send logs to Google Cloud Storage for [archiving][1] and [rehydration][2], you must [configure Log Archives](#configure-log-archives). If you do not want to rehydrate logs in Datadog, skip to [Set up the destination for your pipeline](#set-up-the-destinations).

Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Google Pub/Sub Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

## Overview

Use Observability Pipelines' Google Pub/Sub destination to publish logs to the Google Pub/Sub messaging system, so the logs can be sent to downstream services, data lakes, or custom applications.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: HTTP Client Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

## Overview

Use Observability Pipelines' HTTP Client destination to send logs to an HTTP client, such as a logging platform or SIEM.
Expand Down
5 changes: 5 additions & 0 deletions content/en/observability_pipelines/destinations/kafka.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Kafka Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

## Overview

Use Observability Pipelines' Kafka destination to send logs to Kafka topics.
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Microsoft Sentinel Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Microsoft Sentinel destination to send logs to Microsoft Sentinel. See [Logs Ingestion API][3] for API call limits in Microsoft Sentinel.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: New Relic Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' New Relic destination to send logs to New Relic.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: OpenSearch Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' OpenSearch destination to send logs to OpenSearch.

## Setup
Expand Down
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,13 @@ further_reading:
- link: "https://www.datadoghq.com/blog/observability-pipelines-sentinelone/"
tag: "blog"
text: "Optimize EDR logs and route them to SentinelOne with Observability Pipelines"
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' SentinelOne destination to send logs to SentinelOne.

## Setup
Expand Down
5 changes: 5 additions & 0 deletions content/en/observability_pipelines/destinations/socket.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Socket Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Socket destination to send logs to a socket endpoint.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Splunk HTTP Event Collector (HEC) Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Splunk HTTP Event Collector (HEC) destination to send logs to Splunk HEC.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Sumo Logic Hosted Collector Destination
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' Sumo Logic destination to send logs to your Sumo Logic Hosted Collector.

## Setup
Expand Down
5 changes: 5 additions & 0 deletions content/en/observability_pipelines/destinations/syslog.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Syslog Destinations
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

Use Observability Pipelines' syslog destinations to send logs to rsyslog or syslog-ng.

## Setup
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Add Environment Variables Processor
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

{{% observability_pipelines/processors/add_env_vars %}}

{{% observability_pipelines/processors/filter_syntax %}}
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Add Hostname Processor
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

{{% observability_pipelines/processors/add_hostname %}}

{{% observability_pipelines/processors/filter_syntax %}}
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,13 @@ further_reading:
- link: "/observability_pipelines/guide/remap_reserved_attributes/"
tag: "documentation"
text: "Remap reserved attributes"
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

{{% observability_pipelines/processors/custom_processor %}}

## Custom functions
Expand Down
5 changes: 5 additions & 0 deletions content/en/observability_pipelines/processors/dedupe.md
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Deduplicate Processor
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

{{% observability_pipelines/processors/dedupe %}}

{{% observability_pipelines/processors/filter_syntax %}}
Original file line number Diff line number Diff line change
Expand Up @@ -5,8 +5,13 @@ further_reading:
- link: "/observability_pipelines/guide/remap_reserved_attributes/"
tag: "documentation"
text: "Remap reserved attributes"
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

{{% observability_pipelines/processors/remap %}}

{{% observability_pipelines/processors/filter_syntax %}}
Expand Down
Original file line number Diff line number Diff line change
@@ -1,8 +1,13 @@
---
title: Enrichment Table Processor
disable_toc: false
products:
- name: Logs
icon: logs
---

{{< product-availability >}}

{{% observability_pipelines/processors/enrichment_table %}}

{{% observability_pipelines/processors/filter_syntax %}}
Loading
Loading