Scrubkit.Parquet 1.4.0

Prefix Reserved
dotnet add package Scrubkit.Parquet --version 1.4.0
                    
NuGet\Install-Package Scrubkit.Parquet -Version 1.4.0
                    
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Scrubkit.Parquet" Version="1.4.0" />
                    
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="Scrubkit.Parquet" Version="1.4.0" />
                    
Directory.Packages.props
<PackageReference Include="Scrubkit.Parquet" />
                    
Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add Scrubkit.Parquet --version 1.4.0
                    
#r "nuget: Scrubkit.Parquet, 1.4.0"
                    
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package Scrubkit.Parquet@1.4.0
                    
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=Scrubkit.Parquet&version=1.4.0
                    
Install as a Cake Addin
#tool nuget:?package=Scrubkit.Parquet&version=1.4.0
                    
Install as a Cake Tool

Scrubkit.Parquet

NuGet License: MPL 2.0

Writes a Scrubkit FileRecord table to Apache Parquet (columnar) for data-lake and analytics ingestion, using Parquet.Net.

The core Scrubkit package already ships zero-dependency CSV and JSON writers (TableWriter). Reach for this package only when you specifically need Parquet — it keeps that dependency out of the core.

Install

dotnet add package Scrubkit.Parquet

Use it

using Scrubkit;

var table = await new FolderScrubber().ReadAsync(@"C:\Docs");

await ParquetTableWriter.WriteFileAsync(table, @"C:\out\files.parquet");
// or write to any stream:
await ParquetTableWriter.WriteAsync(table, stream);

Columns: Path, Name, Extension, Folder, SizeBytes, Modified, TypeBucket, Text, Warnings, Redactions, ContentHash.

Modified is always stored in UTC — a Parquet timestamp is an instant, so read it back and convert with value.ToLocalTime() if you need a local view. (The core's CSV/JSON TableWriter additionally supports a utc: false option, since text formats can carry an explicit offset; Parquet cannot.)

License

Mozilla Public License 2.0.

Product Compatible and additional computed target framework versions.
.NET net8.0 is compatible.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed.  net9.0 was computed.  net9.0-android was computed.  net9.0-browser was computed.  net9.0-ios was computed.  net9.0-maccatalyst was computed.  net9.0-macos was computed.  net9.0-tvos was computed.  net9.0-windows was computed.  net10.0 was computed.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages (1)

Showing the top 1 NuGet packages that depend on Scrubkit.Parquet:

Package Downloads
Scrubkit.All

Convenience meta-package that references the entire Scrubkit family: the core (PDF/Office/text/image EXIF + CSV/JSON output), the extractor add-ons (.eml, OpenDocument, .epub), the AddScrubkit dependency-injection integration, and — on net8.0 — Parquet output. Install this to read everything out of the box; install the individual packages instead if you want a lean footprint. No code of its own.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
1.4.0 46 7/20/2026

1.4.0 — Output: zero-dep CSV/JSON writers (TableWriter) with UTC-by-default timestamps and an opt-in utc:false local-time mode, plus a new Scrubkit.Parquet package (Apache Parquet via Parquet.Net, net8.0). Diagnostics: ReadOptions.OnDiagnostic hook bridged to ILogger by AddScrubkit. Opt-in SHA-256 content hashing (FileRecord.ContentHash). New Scrubkit.All meta-package bundles the whole family. Default MaxBytesPerFile lowered to 10 MB; FileRecord.Modified is now UTC. Fix: redaction no longer drops a match overlapping a higher-priority span. Full changelog: https://github.com/jjopensoftworks-blip/Scrubkit/blob/main/CHANGELOG.md