Datafication.ParquetConnector
1.0.9
dotnet add package Datafication.ParquetConnector --version 1.0.9
NuGet\Install-Package Datafication.ParquetConnector -Version 1.0.9
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Datafication.ParquetConnector" Version="1.0.9" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="Datafication.ParquetConnector" Version="1.0.9" />
<PackageReference Include="Datafication.ParquetConnector" />
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add Datafication.ParquetConnector --version 1.0.9
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: Datafication.ParquetConnector, 1.0.9"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package Datafication.ParquetConnector@1.0.9
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=Datafication.ParquetConnector&version=1.0.9
#tool nuget:?package=Datafication.ParquetConnector&version=1.0.9
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
Datafication.ParquetConnector
Apache Parquet columnar format connector for Datafication DataBlocks.
Key Features
- Columnar Efficiency: Industry-standard Parquet format for fast reads
- Row Group Support: Track and utilize row groups for large datasets
- Multiple Sources: Load from local files or remote URLs
- Streaming Support: Batch loading for files with millions of rows
- Compression Options: Gzip, Snappy, or uncompressed output
- Type Preservation: Maintains Parquet schema types
Installation
dotnet add package Datafication.ParquetConnector
Quick Start
using Datafication.Connectors.ParquetConnector;
// Load Parquet with shorthand method
var data = await DataBlock.Connector.LoadParquetAsync("data/events.parquet");
// Load with full configuration
var config = new ParquetConnectorConfiguration
{
Source = new Uri("file:///data/analytics.parquet"),
BatchSize = 100000
};
var connector = new ParquetDataConnector(config);
var analyticsData = await connector.GetDataAsync();
// Export DataBlock to Parquet
await data.ParquetSinkAsync("output/results.parquet", CompressionMethod.Gzip);
Documentation
For samples, usage examples, and source code, visit our GitHub repository: github.com/DataficationSDK/Datafication.ParquetConnector
If you find this library useful, consider giving it a star!
For full API documentation and guides: datafication.co
License
Licensed under the Datafication SDK License Agreement.
- Free: <5 developers AND <$500K annual revenue
- Commercial license required: 5+ developers OR >$500K annual revenue
For licensing inquiries: support@datafication.co
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
net8.0
- Datafication.Core (>= 1.0.9)
- Parquet.Net (>= 4.23.4)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on Datafication.ParquetConnector:
| Package | Downloads |
|---|---|
|
Datafication.S3Connector
AWS S3 and S3-compatible storage connector for Datafication DataBlocks |
GitHub repositories
This package is not used by any popular GitHub repositories.