dtpipe 1.17.0

dotnet tool install --global dtpipe --version 1.17.0
                    
This package contains a .NET tool you can call from the shell/command line.
dotnet new tool-manifest
                    
if you are setting up this repo
dotnet tool install --local dtpipe --version 1.17.0
                    
This package contains a .NET tool you can call from the shell/command line.
#tool dotnet:?package=dtpipe&version=1.17.0
                    
nuke :add-package dtpipe --version 1.17.0
                    

DtPipe

A command-line tool that moves data between databases, files and object storage, and transforms or anonymizes it on the way. One self-contained binary; nothing is staged in between.

Install

dotnet tool install -g dtpipe        # or download a binary from the releases page
dtpipe --help

Linux, macOS and Windows, x64 and arm64. The .NET runtime, DuckDB and every database driver are inside the binary. Details: docs/install.md.

Example

Anonymize a table on the way out, so the clear values never reach the disk:

dtpipe \
  -i "pg:Host=localhost;Database=prod;Username=postgres" \
  --query "SELECT * FROM users" \
  --fake "email:internet.email" \
  --fake "name:name.fullName" \
  --mask "phone:###-****" \
  --null "ssn" \
  -o anonymized_users.parquet

A first pipeline in six steps, with no database to set up: docs/quickstart.md.

What it connects to

Family Prefix
Databases pg:, mysql:, sqlite:, duck:, mssql:, ora:
Files csv:, jsonl:, parquet:, arrow:, xml:, or just the file extension
Object storage s3://bucket/key.parquet, azure://container/blob.csv
Test endpoints generate:N (a source), null: and checksum: (sinks)

dtpipe providers lists what your binary carries.

Documentation

docs/ Start here: install, quickstart, concepts, a guide per task, a page per connection
REFERENCE.md The flags in common use, the YAML job schema, provider options, the MCP tools. dtpipe --help lists every flag
EXTENDING.md Writing a new adapter or transformer

Beyond the command line: one pipeline across several hosts (docs/distributed.md), dtpipe studio to design and preview jobs in a local page, with an AI assistant if you give it a model, and dtpipe mcp for an assistant you already use.

License

MIT

Product Compatible and additional computed target framework versions.
.NET net10.0 is compatible.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

This package has no dependencies.

Version Downloads Last Updated
1.17.0 74 11/16/2026
1.16.1 95 11/12/2026
1.16.0 106 11/11/2026
1.15.2 104 11/10/2026
1.15.1 104 11/10/2026
1.15.0 96 11/9/2026
1.14.0 99 11/8/2026
1.13.0 101 11/6/2026
1.12.0 111 11/5/2026
1.11.0 108 11/4/2026
1.10.0 157 10/18/2026
1.9.0 152 10/2/2026
1.8.2 150 9/14/2026
1.8.1 130 9/10/2026
1.8.0 222 9/9/2026
1.7.0 135 9/5/2026
1.6.0 210 8/27/2026
1.5.0 185 8/6/2026
1.4.3 165 7/7/2026
1.4.2 157 6/20/2026
Loading failed