NLog.Azure.Kusto 2.0.1

dotnet add package NLog.Azure.Kusto --version 2.0.1
NuGet\Install-Package NLog.Azure.Kusto -Version 2.0.1
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="NLog.Azure.Kusto" Version="2.0.1" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add NLog.Azure.Kusto --version 2.0.1
#r "nuget: NLog.Azure.Kusto, 2.0.1"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
// Install NLog.Azure.Kusto as a Cake Addin
#addin nuget:?package=NLog.Azure.Kusto&version=2.0.1

// Install NLog.Azure.Kusto as a Cake Tool
#tool nuget:?package=NLog.Azure.Kusto&version=2.0.1

NLog.Azure.Kusto

An Azure Data Explorer(ADX) custom target that writes log events to an Azure Data Explorer (Kusto) cluster.

Package - NLog.Azure.Kusto | Platforms - .Net 6.0

You can now use the Kusto NLog connector with free Kusto cluster and Microsoft Fabric cluster URLs by providing the cluster URL in the ConnectionString parameter of the ADXTarget configuration.

!! BREAKING CHANGE !!

IngestionEndpoint will not be supported from verison 2.0.0. It has been replaced with Connection String based authentication. With Connection String based authentication, you can use different modes of authentication, such as User Prompt Authentication, User Token Authentication, and more. To learn more about Kusto connection strings and the authentication modes they support, please visit Kusto connection strings.

Getting started

Install from NuGet:

dotnet add package NLog.Azure.Kusto --version 2.0.1

Configuration

Add the ADX target to your NLog configuration:

<nlog>
  <extensions>
    <add assembly="NLog.Azure.Kusto"/>
  </extensions>
  <targets>
   
    <target name="adxtarget" type="ADXTarget"
      ConnectionString="<ADX connection string>"
      Database="<ADX database name>"
      TableName="<ADX table name>">
        <contextproperty name="HostName" layout="${hostname}" />  
    </target>
  </targets>
  <rules>
    <logger minlevel="Info" name="*" writeTo="adxtarget"/>
  </rules>
</nlog>

Available Configuration Options

Destination Option Description
ConnectionString Kusto connection string. Eg: Data Source=https://ingest-<clustername>.<region>.kusto.windows.net;Fed=True. Read about Kusto Connection String
Database The name of the database to which data should be ingested into.
TableName The name of the table to which data should be ingested.
ManagedIdentityClientId In case of ManagedIdentity Authentication, this need to be set for user assigned identity ("system" = SystemManagedIdentity)
AzCliAuth Enable ADX connector to use Azure CLI authentication
FlushImmediately In case queued ingestion is selected, this property determines if is needed to flush the data immediately to ADX cluster. Not recommended to enable for data with higher workloads. The default is false.
MappingNameRef Use a data mapping configured in ADX.
ApplicationName Override default application-name
ApplicationVersion Override default application-version
Payload Option Description
Layout Formatting of the ADX-event FormattedMessage. The default is: ${logger}${message}
IncludeEventProperties Include LogEvent Properties in the ADX-event. The default is true
ContextProperty Include additional ContextProperties in the ADX-event. The default is empty collection.
BatchSize Gets or sets the number of log events that should be processed in a batch by the lazy writer thread. (Default 1)
TaskDelayMilliseconds How many milliseconds to delay the actual send payload operation to optimize for batching (Default 1 ms)
QueueLimit Gets or sets the limit on the number of requests in the lazy writer thread request queue (Default 10000)
OverflowAction Gets or sets the action (Discard, Grow, Block) to be taken when the lazy writer thread request queue count exceeds the set limit (Default Discard)

IngestionEndpointUri is longer supported with Version 2.0.0, as it has been replaced by Connection String based authentication. Read more about Kusto connection strings

Mapping

Azure Data Explorer provides data mapping capabilities, allowing the ability to extract data rom the ingested JSONs as part of the ingestion. This allows paying a one-time cost of processing the JSON during ingestion, and reduced cost at query time.

By default, the sink uses the following data mapping:

Column Name Column Type JSON Path
Timestamp datetime $.Timestamp
Level string $.Level
Message string $.Message
FormattedMessage dynamic $.FormattedMessage
Exception string $.Exception
Properties dynamic $.Properties

This mapping can be overridden using the following options:

  • MappingNameRef: Use a data mapping configured in ADX.

Authentication

Authentication will be taken according to the kusto connection string passed in the nlog target configuration.

There are few cases to keep in mind for the following authentication modes:

  1. Managed Identity Authentication
    • This authentication mode can be of two types System Assigned Managed Identity and User Assigned Managed Identity. In case of User Assigned Managed Identity, it requires the following properties to be set in the nlog target configuration::
      • ManagedIdentityClientId :
        • system : This will enable managed identity authentication for system assigned managed identity.
        • <clientId>: Setting ManagedIdentityClientId to a specific clientId will enable managed identity authentication for user assigned managed identity.
  2. AzCliAuth
    • This authentication mode will use the Azure CLI to authenticate. This authentication mode will only work when the application is running on a machine with Azure CLI installed and logged in. Accepted values true or false. Default value is false.

Running tests

To run the tests locally, you need to have an ADX cluster created.

  1. Export environment variables for the following:

    • For Windows:

        $env:CONNECTION_STRING="<connectionString>"
        $env:DATABASE="<databaseName>"
      
    • For Mac/Linux:

        export CONNECTION_STRING="<connectionString>"
        export DATABASE="<databaseName>"
      
  2. Run the tests using the following command:

      dotnet test
    
Product Compatible and additional computed target framework versions.
.NET net6.0 is compatible.  net6.0-android was computed.  net6.0-ios was computed.  net6.0-maccatalyst was computed.  net6.0-macos was computed.  net6.0-tvos was computed.  net6.0-windows was computed.  net7.0 was computed.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last updated
2.0.1 815 10/5/2023
2.0.0 174 8/17/2023
1.1.0 145 7/7/2023
1.0.0 217 5/22/2023