SmartPipe.Extensions 1.0.4

Suggested Alternatives

SmartPipe.Extensions 1.0.5

Additional Details

Critical bugs fixed in v1.0.5. Thread-safety, evasion detection, P-controller fixes.

There is a newer version of this package available.
See the version list below for details.
dotnet add package SmartPipe.Extensions --version 1.0.4
                    
NuGet\Install-Package SmartPipe.Extensions -Version 1.0.4
                    
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="SmartPipe.Extensions" Version="1.0.4" />
                    
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="SmartPipe.Extensions" Version="1.0.4" />
                    
Directory.Packages.props
<PackageReference Include="SmartPipe.Extensions" />
                    
Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add SmartPipe.Extensions --version 1.0.4
                    
#r "nuget: SmartPipe.Extensions, 1.0.4"
                    
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package SmartPipe.Extensions@1.0.4
                    
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=SmartPipe.Extensions&version=1.0.4
                    
Install as a Cake Addin
#tool nuget:?package=SmartPipe.Extensions&version=1.0.4
                    
Install as a Cake Tool

SmartPipe.Extensions

One package. All integrations. Zero boilerplate. Ready-to-use components for SmartPipe.Core — build ETL pipelines in minutes.

Extensions for SmartPipe.Core providing ready-to-use selectors, transforms, sinks, and health checks for building production ETL pipelines in minutes.

Selectors (Data Sources)

Selector Library Description
HttpSelector<T> HttpClient + Polly Fetch data from REST APIs
EfCoreSelector<T> Entity Framework Core Stream entities from database
DapperSelector<T> Dapper High-performance SQL queries
CsvFileSource<T> CsvHelper Read CSV files
JsonFileSource<T> System.Text.Json Read JSON arrays and NDJSON
DeadLetterSource<T> System.Text.Json Replay failed items

Transforms

Transform Library Description
JsonTransform<TIn,TOut> System.Text.Json JSON serialization
CsvTransform<TIn,TOut> CsvHelper CSV parsing
MapsterTransform<TIn,TOut> Mapster Object mapping
CompressionTransform System.IO.Compression Brotli/GZip compression
PollyResilienceTransform<T> Polly v8 Retry/CircuitBreaker/Hedging
FilterTransform<T> Predicate-based filtering with And/Or/Not
ValidationTransform<T> DataAnnotations Data validation with custom rules
ConditionalTransform<T> Apply transform only when condition met
CompositeTransform<T> Chain multiple transforms into one

Sinks (Data Destinations)

Sink Library Description
LoggerSink<T> ILogger Structured logging
DeadLetterSink<T> System.Text.Json Persist failed items to JSON
HttpSink<T> HttpClient + Polly Send data to REST APIs
DbSink<T> Dapper Insert into any database
CsvFileSink<T> CsvHelper Write CSV files
JsonFileSink<T> System.Text.Json Write JSON files

Health Checks

Component Description
SmartPipeLivenessCheck Is pipeline alive? (Kubernetes liveness probe)
SmartPipeReadinessCheck Can pipeline accept data? (Kubernetes readiness probe)

Hosting

Component Description
SmartPipeHostedService ASP.NET Core BackgroundService
AddSmartPipeResilience() DI registration for Polly pipelines

Streaming

Component Description
ChannelMerge Merge two ChannelReader streams

Installation

dotnet add package SmartPipe.Extensions

Requirements

  • .NET 10.0+
  • SmartPipe.Core 1.0.4 (included as dependency)
  • Zero additional dependencies required for basic usage
  • Individual features pull their own dependencies:
    • HttpSelector / HttpSink → Polly (via Microsoft.Extensions.Resilience)
    • EfCoreSelector → Entity Framework Core
    • DapperSelector / DbSink → Dapper
    • MapsterTransform → Mapster
    • CsvFileSource / CsvFileSink / CsvTransform → CsvHelper
    • PollyResilienceTransform → Polly.Core
    • SmartPipeHostedService / SmartPipeHealthCheck → Microsoft.Extensions.Hosting / HealthChecks
    • All other components (FilterTransform, ValidationTransform, ConditionalTransform, CompositeTransform, LoggerSink, DeadLetterSink, JsonFileSource, JsonFileSink) — zero additional dependencies

License

MIT License — see LICENSE for details.

Product Compatible and additional computed target framework versions.
.NET net10.0 is compatible.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.