SmartPipe.Extensions
1.0.4
Suggested Alternatives
Additional Details
Critical bugs fixed in v1.0.5. Thread-safety, evasion detection, P-controller fixes.
There is a newer version of this package available.
See the version list below for details.
See the version list below for details.
dotnet add package SmartPipe.Extensions --version 1.0.4
NuGet\Install-Package SmartPipe.Extensions -Version 1.0.4
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="SmartPipe.Extensions" Version="1.0.4" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="SmartPipe.Extensions" Version="1.0.4" />
<PackageReference Include="SmartPipe.Extensions" />
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add SmartPipe.Extensions --version 1.0.4
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: SmartPipe.Extensions, 1.0.4"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package SmartPipe.Extensions@1.0.4
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=SmartPipe.Extensions&version=1.0.4
#tool nuget:?package=SmartPipe.Extensions&version=1.0.4
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
SmartPipe.Extensions
One package. All integrations. Zero boilerplate. Ready-to-use components for SmartPipe.Core — build ETL pipelines in minutes.
Extensions for SmartPipe.Core providing ready-to-use selectors, transforms, sinks, and health checks for building production ETL pipelines in minutes.
Selectors (Data Sources)
| Selector | Library | Description |
|---|---|---|
HttpSelector<T> |
HttpClient + Polly | Fetch data from REST APIs |
EfCoreSelector<T> |
Entity Framework Core | Stream entities from database |
DapperSelector<T> |
Dapper | High-performance SQL queries |
CsvFileSource<T> |
CsvHelper | Read CSV files |
JsonFileSource<T> |
System.Text.Json | Read JSON arrays and NDJSON |
DeadLetterSource<T> |
System.Text.Json | Replay failed items |
Transforms
| Transform | Library | Description |
|---|---|---|
JsonTransform<TIn,TOut> |
System.Text.Json | JSON serialization |
CsvTransform<TIn,TOut> |
CsvHelper | CSV parsing |
MapsterTransform<TIn,TOut> |
Mapster | Object mapping |
CompressionTransform |
System.IO.Compression | Brotli/GZip compression |
PollyResilienceTransform<T> |
Polly v8 | Retry/CircuitBreaker/Hedging |
FilterTransform<T> |
— | Predicate-based filtering with And/Or/Not |
ValidationTransform<T> |
DataAnnotations | Data validation with custom rules |
ConditionalTransform<T> |
— | Apply transform only when condition met |
CompositeTransform<T> |
— | Chain multiple transforms into one |
Sinks (Data Destinations)
| Sink | Library | Description |
|---|---|---|
LoggerSink<T> |
ILogger | Structured logging |
DeadLetterSink<T> |
System.Text.Json | Persist failed items to JSON |
HttpSink<T> |
HttpClient + Polly | Send data to REST APIs |
DbSink<T> |
Dapper | Insert into any database |
CsvFileSink<T> |
CsvHelper | Write CSV files |
JsonFileSink<T> |
System.Text.Json | Write JSON files |
Health Checks
| Component | Description |
|---|---|
SmartPipeLivenessCheck |
Is pipeline alive? (Kubernetes liveness probe) |
SmartPipeReadinessCheck |
Can pipeline accept data? (Kubernetes readiness probe) |
Hosting
| Component | Description |
|---|---|
SmartPipeHostedService |
ASP.NET Core BackgroundService |
AddSmartPipeResilience() |
DI registration for Polly pipelines |
Streaming
| Component | Description |
|---|---|
ChannelMerge |
Merge two ChannelReader streams |
Installation
dotnet add package SmartPipe.Extensions
Requirements
- .NET 10.0+
- SmartPipe.Core 1.0.4 (included as dependency)
- Zero additional dependencies required for basic usage
- Individual features pull their own dependencies:
HttpSelector/HttpSink→ Polly (via Microsoft.Extensions.Resilience)EfCoreSelector→ Entity Framework CoreDapperSelector/DbSink→ DapperMapsterTransform→ MapsterCsvFileSource/CsvFileSink/CsvTransform→ CsvHelperPollyResilienceTransform→ Polly.CoreSmartPipeHostedService/SmartPipeHealthCheck→ Microsoft.Extensions.Hosting / HealthChecks- All other components (FilterTransform, ValidationTransform, ConditionalTransform, CompositeTransform, LoggerSink, DeadLetterSink, JsonFileSource, JsonFileSink) — zero additional dependencies
License
MIT License — see LICENSE for details.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
net10.0
- CsvHelper (>= 33.0.1)
- Dapper (>= 2.1.66)
- Mapster (>= 7.4.0)
- Microsoft.EntityFrameworkCore (>= 10.0.0-preview.3.25171.5)
- Microsoft.Extensions.Diagnostics.HealthChecks (>= 10.0.0-preview.3.25171.5)
- Microsoft.Extensions.Hosting.Abstractions (>= 10.0.0-preview.3.25171.5)
- Microsoft.Extensions.Logging.Abstractions (>= 10.0.0-preview.3.25171.5)
- Microsoft.Extensions.Resilience (>= 9.4.0)
- SmartPipe.Core (>= 1.0.4)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.