From 4990ba766779831e7b41fe72594663f5428fafd7 Mon Sep 17 00:00:00 2001 From: vplauzon Date: Tue, 18 Nov 2025 02:57:52 -0500 Subject: [PATCH 1/6] Mention queued ingestion commands --- data-explorer/lightingest.md | 5 ++++- 1 file changed, 4 insertions(+), 1 deletion(-) diff --git a/data-explorer/lightingest.md b/data-explorer/lightingest.md index 01284fc7dc..7003e6a83c 100644 --- a/data-explorer/lightingest.md +++ b/data-explorer/lightingest.md @@ -3,7 +3,7 @@ title: Use LightIngest to ingest data into Azure Data Explorer description: Learn about LightIngest, a command-line utility for ad-hoc data ingestion into Azure Data Explorer. ms.reviewer: tzgitlin ms.topic: how-to -ms.date: 11/03/2025 +ms.date: 11/18/2025 --- # Use LightIngest to ingest data into Azure Data Explorer @@ -27,6 +27,9 @@ For an example of how to autogenerate a LightIngest command, see [ingest histori dotnet tool install -g Microsoft.Azure.Kusto.LightIngest ``` +> [!NOTE] +> Consider using the [queued ingestion commands](kusto/management/data-ingestion/queued-ingestion-use-case.md) as they do not require installing software. + ## Run LightIngest To run LightIngest: From 927aeef119ce70e153fa92b32c20b06a8e91d58c Mon Sep 17 00:00:00 2001 From: ktalmor <193799742+ktalmor@users.noreply.github.com> Date: Mon, 1 Dec 2025 17:41:23 +0200 Subject: [PATCH 2/6] new PR --- .../kusto/api/get-started/app-client-network-restrictions.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/data-explorer/kusto/api/get-started/app-client-network-restrictions.md b/data-explorer/kusto/api/get-started/app-client-network-restrictions.md index bf6c975fb4..927f6d264e 100644 --- a/data-explorer/kusto/api/get-started/app-client-network-restrictions.md +++ b/data-explorer/kusto/api/get-started/app-client-network-restrictions.md @@ -5,7 +5,7 @@ ms.reviewer: yogilad ms.author: spelluru author: spelluru ms.topic: how-to -ms.date: 11/16/2025 +ms.date: 12/01/2025 ms.custom: --- From 22bcb7c2367028258a9d47b1f2550659555e4075 Mon Sep 17 00:00:00 2001 From: ktalmor <193799742+ktalmor@users.noreply.github.com> Date: Mon, 1 Dec 2025 17:43:03 +0200 Subject: [PATCH 3/6] removed Perkus as per VP --- .../kusto/api/get-started/app-client-network-restrictions.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/data-explorer/kusto/api/get-started/app-client-network-restrictions.md b/data-explorer/kusto/api/get-started/app-client-network-restrictions.md index 927f6d264e..e76691eade 100644 --- a/data-explorer/kusto/api/get-started/app-client-network-restrictions.md +++ b/data-explorer/kusto/api/get-started/app-client-network-restrictions.md @@ -49,7 +49,7 @@ This article gives step-by-step guidance on managing DNS restrictions in Kusto t For command-line applications and tools, disable DNS validation entirely by passing a command-line argument or setting an environment variable. > [!NOTE] -> Disabling DNS validation using environment variables affects all applications and tools using the C# SDK, including Kusto Explorer, Light Ingest, Kusto CLI, Perkus, and any third-party application developed with the C# Kusto SDK. +> Disabling DNS validation using environment variables affects all applications and tools using the C# SDK, including Kusto Explorer, Light Ingest, Kusto CLI, and any third-party application developed with the C# Kusto SDK. To disable using a command-line argument, add the following argument to the tool's command line. From 65b54165ca523f0ba90aae38e41378561f449012 Mon Sep 17 00:00:00 2001 From: ktalmor <193799742+ktalmor@users.noreply.github.com> Date: Mon, 1 Dec 2025 17:46:21 +0200 Subject: [PATCH 4/6] added link to web UI --- .../kusto/api/get-started/app-client-network-restrictions.md | 4 ++-- 1 file changed, 2 insertions(+), 2 deletions(-) diff --git a/data-explorer/kusto/api/get-started/app-client-network-restrictions.md b/data-explorer/kusto/api/get-started/app-client-network-restrictions.md index e76691eade..e32d90efe6 100644 --- a/data-explorer/kusto/api/get-started/app-client-network-restrictions.md +++ b/data-explorer/kusto/api/get-started/app-client-network-restrictions.md @@ -35,9 +35,9 @@ This article gives step-by-step guidance on managing DNS restrictions in Kusto t :::image type="content" source="../../media/bypass-dns-restrictions/kusto-explorer-options.png" alt-text="Screenshot of the Options editor open with the Additional Trusted Hosts field highlighted."::: -## Bypass DNS restrictions with Azure Data Explorer +## Bypass DNS restrictions with Azure Data Explorer web UI -1. Open Azure Data Explorer. +1. Open [Azure Data Explorer](https://dataexplorer.azure.com/home). 1. Select the *Settings* icon in the top-right corner. 1. Select **Connection**. 1. In **Additional trusted hosts**, add the fully qualified hostname or DNS suffix (preceded with an asterisk `*`) you want to work with. List multiple FQDNs or DNS suffixes by separating them with a semicolon `;`. From de721c7cc3030a6ccc7459cb0d62bb28d133493f Mon Sep 17 00:00:00 2001 From: ktalmor <193799742+ktalmor@users.noreply.github.com> Date: Mon, 1 Dec 2025 18:13:07 +0200 Subject: [PATCH 5/6] fix link + formatting --- data-explorer/lightingest.md | 15 +++++++-------- 1 file changed, 7 insertions(+), 8 deletions(-) diff --git a/data-explorer/lightingest.md b/data-explorer/lightingest.md index 7003e6a83c..235ff2cc75 100644 --- a/data-explorer/lightingest.md +++ b/data-explorer/lightingest.md @@ -7,7 +7,7 @@ ms.date: 11/18/2025 --- # Use LightIngest to ingest data into Azure Data Explorer - + [LightIngest](https://github.com/Azure/Kusto-Lightingest/blob/main/README.md) is a command-line utility for ad-hoc data ingestion into Azure Data Explorer. The utility can pull source data from a local folder, an Azure blob storage container, or an Amazon S3 bucket. LightIngest is most useful when you want to ingest a large amount of data, because there's no time constraint on ingestion duration. It's also useful when you want to later query records according to the time they were created, and not the time they were ingested. @@ -20,7 +20,7 @@ For an example of how to autogenerate a LightIngest command, see [ingest histori * LightIngest. Get LightIngest in one of two ways: * [Download LightIngest binaries for your operating system](https://github.com/Azure/Kusto-Lightingest/releases). Make sure to unzip the binaries after download. - + * [Install LightIngest as a .NET tool](https://www.nuget.org/packages/Microsoft.Azure.Kusto.LightIngest). This method requires that you have the .NET SDK version 6.0 or higher installed on your machine. Then, run the following command: ``` @@ -28,7 +28,7 @@ For an example of how to autogenerate a LightIngest command, see [ingest histori ``` > [!NOTE] -> Consider using the [queued ingestion commands](kusto/management/data-ingestion/queued-ingestion-use-case.md) as they do not require installing software. +> Consider using the [queued ingestion commands](kusto/management/data-ingestion/queued-ingestion-use-case?view=azure-data-explorer&preserve-view=true) as they do not require installing software. ## Run LightIngest @@ -113,10 +113,10 @@ The argument values must include: > [!IMPORTANT] > When you specify that the creation time should be overridden, make sure the `Lookback` property in the target table's effective [Extents merge policy](/kusto/management/merge-policy?view=azure-data-explorer&preserve-view=true) aligns with the values in your file or blob paths. -**Examples** +**Examples** + +* A blob name that contains the datetime as follows: `historicalvalues19840101.parquet` (the timestamp is four digits for the year, two digits for the month, and two digits for the day of month), -* A blob name that contains the datetime as follows: `historicalvalues19840101.parquet` (the timestamp is four digits for the year, two digits for the month, and two digits for the day of month), - The value for `-creationTimePattern` argument is part of the filename: *"'historicalvalues'yyyyMMdd'.parquet'"* ```kusto @@ -124,7 +124,7 @@ The argument values must include: -pattern:"*.parquet" -format:parquet -limit:2 -cr:10.0 -dontWait:true ``` -* For a blob URI that refers to hierarchical folder structure, like `https://storageaccount/mycontainer/myfolder/2002/12/01/blobname.extension`, +* For a blob URI that refers to hierarchical folder structure, like `https://storageaccount/mycontainer/myfolder/2002/12/01/blobname.extension`, The value for `-creationTimePattern` argument is part of the folder structure: *"'folder/'yyyy/MM/dd'/blob'"* @@ -223,4 +223,3 @@ LightIngest performs three actions that can use managed identity for authenticat * **Connect to Azure Storage to download blobs**: Use "-ingestmi" to specify a managed identity installed on the Kusto service that has read privileges on the storage container. * **Connect to Azure Storage to list container blobs**: Use the "-storageMi" argument to specify a managed identity installed on the client VM that has list privileges on the storage container. If you use this method but not the previous one (connect to Azure storage to download blobs), the managed identity must have read privileges as well and a token is passed to the Kusto service to be used for the ingestion. Set all three arguments. - From 6124db07560920299b00e2009fac2811428104b0 Mon Sep 17 00:00:00 2001 From: ktalmor <193799742+ktalmor@users.noreply.github.com> Date: Mon, 1 Dec 2025 18:17:53 +0200 Subject: [PATCH 6/6] final --- data-explorer/lightingest.md | 2 +- 1 file changed, 1 insertion(+), 1 deletion(-) diff --git a/data-explorer/lightingest.md b/data-explorer/lightingest.md index 235ff2cc75..a933b028ad 100644 --- a/data-explorer/lightingest.md +++ b/data-explorer/lightingest.md @@ -28,7 +28,7 @@ For an example of how to autogenerate a LightIngest command, see [ingest histori ``` > [!NOTE] -> Consider using the [queued ingestion commands](kusto/management/data-ingestion/queued-ingestion-use-case?view=azure-data-explorer&preserve-view=true) as they do not require installing software. +> Consider using the [queued ingestion commands](/kusto/management/data-ingestion/queued-ingestion-use-case?view=azure-data-explorer&preserve-view=true) as they do not require installing software. ## Run LightIngest