Datafication.S3Connector
1.0.11
dotnet add package Datafication.S3Connector --version 1.0.11
NuGet\Install-Package Datafication.S3Connector -Version 1.0.11
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Datafication.S3Connector" Version="1.0.11" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="Datafication.S3Connector" Version="1.0.11" />
<PackageReference Include="Datafication.S3Connector" />
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add Datafication.S3Connector --version 1.0.11
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: Datafication.S3Connector, 1.0.11"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package Datafication.S3Connector@1.0.11
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=Datafication.S3Connector&version=1.0.11
#tool nuget:?package=Datafication.S3Connector&version=1.0.11
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
Datafication.S3Connector
AWS S3 and S3-compatible storage connector for Datafication DataBlocks.
Key Features
- Multi-Format Support: Auto-detect CSV, JSON, Parquet, and Excel files
- Single & Multi-Segment Modes: Memory or disk-backed loading
- Multiple Auth Methods: AWS credentials, STS temporary tokens, anonymous
- S3-Compatible Services: MinIO, DigitalOcean Spaces, Wasabi
- Prefix Patterns: Load multiple files with wildcard matching
- Memory-Safe Streaming: Bounded memory for large datasets
- Configurable Batch Sizes: Control memory usage
Installation
dotnet add package Datafication.S3Connector
Quick Start
using Datafication.Connectors.S3Connector;
// Load single file from S3
var config = new S3ConnectorConfiguration
{
BucketName = "my-bucket",
ObjectKey = "data/sales.csv",
Region = "us-east-1",
AccessKeyId = "AKIAIOSFODNN7EXAMPLE",
SecretAccessKey = "wJalrXUtnFEMI/K7MDENG/bPxRfiCYEXAMPLEKEY"
};
var connector = new S3DataConnector(config);
var salesData = await connector.GetDataAsync();
// Load multiple files with prefix pattern
var multiConfig = new S3ConnectorConfiguration
{
BucketName = "my-bucket",
Prefix = "logs/2024/",
FilePattern = "*.parquet"
};
Documentation
For samples, usage examples, and source code, visit our GitHub repository: github.com/DataficationSDK/Datafication.S3Connector
If you find this library useful, consider giving it a star!
For full API documentation and guides: datafication.co
License
Licensed under the Datafication SDK License Agreement.
- Free: <5 developers AND <$500K annual revenue
- Commercial license required: 5+ developers OR >$500K annual revenue
For licensing inquiries: support@datafication.co
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
net8.0
- AWSSDK.S3 (>= 4.0.6.4)
- Datafication.Core (>= 1.0.11)
- Datafication.CsvConnector (>= 1.0.11)
- Datafication.ExcelConnector (>= 1.0.11)
- Datafication.JsonConnector (>= 1.0.11)
- Datafication.ParquetConnector (>= 1.0.11)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.