HighTechInnovators.RxDatasets
0.14.0
dotnet add package HighTechInnovators.RxDatasets --version 0.14.0
NuGet\Install-Package HighTechInnovators.RxDatasets -Version 0.14.0
<PackageReference Include="HighTechInnovators.RxDatasets" Version="0.14.0" />
<PackageVersion Include="HighTechInnovators.RxDatasets" Version="0.14.0" />
<PackageReference Include="HighTechInnovators.RxDatasets" />
paket add HighTechInnovators.RxDatasets --version 0.14.0
#r "nuget: HighTechInnovators.RxDatasets, 0.14.0"
#:package HighTechInnovators.RxDatasets@0.14.0
#addin nuget:?package=HighTechInnovators.RxDatasets&version=0.14.0
#tool nuget:?package=HighTechInnovators.RxDatasets&version=0.14.0
Sonar Statistics:
License
This project is licensed under the Common Public Attribution License Version 1.0 (CPAL-1.0).
You may obtain a copy of the License in the LICENSE file.
For more details, you can also refer to the full license text at the SPDX website.
Introduction
Reactive Datasets is a project which provides an efficient way to managing status updates of entities in protobuf format. It persistently stores entities in a disk format (On Azure Blob, S3, or in memory). And it allows for the retrieval of entities in a reactive way, allowing clients to get a list of all changed entities since the last time they checked.
A README for the diskformat used to store entities
Features
- Entity Management: Persistent storage and retrieval of protobuf-formatted entities
- Reactive Updates: Delta-based change tracking and notification system
- Storage Flexibility: Support for multiple backends (Local Disk, Azure Blob, S3, Google Cloud Storage, Minio)
- Change Tracking: Efficient tracking of additions, modifications, and deletions
- CountChildren: Query hierarchical entity counts by parent path (useful for testing and validation)
- gRPC Integration: Full gRPC service support for remote access to dataset operations
Configurations
Cleanup Config Options
MinimumAgeToLiveInMinutes - must be at least 120 minutes (default)
MinimumSnapshotsToKeep - must be at least 2 snapshots kept (default)
KeepAllDeltas = true (default); // When disabled, all deltas leading to the outdated snapshot would be deleted, e.g. lets say we have deltas [1,2,3,4,5,6,7,8,9,10] and snapshots [1,4,7, 10] (assuming a snapshot interval of 3), when snapshot 1,4 are deleted, deltas 1,2,3,4,5,6 would also be deleted since the earliest to keep snapshot would 7
IsEnabled = true (default);
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net8.0
- Google.ProtoBuf (>= 3.32.0)
- Grpc.Core.Api (>= 2.71.0)
- HighTechInnovators.RxDatasets.Abstractions (>= 0.14.0)
- Microsoft.Extensions.Caching.Abstractions (>= 9.0.8)
- Microsoft.Extensions.Caching.Memory (>= 9.0.8)
- Microsoft.Extensions.Configuration (>= 9.0.8)
- Microsoft.Extensions.Configuration.Binder (>= 9.0.8)
- Microsoft.Extensions.DependencyInjection (>= 9.0.8)
- Microsoft.Extensions.DependencyInjection.Abstractions (>= 9.0.8)
- Microsoft.Extensions.Diagnostics.HealthChecks (>= 9.0.8)
- Microsoft.Extensions.Diagnostics.HealthChecks.Abstractions (>= 9.0.8)
- Microsoft.Extensions.Hosting (>= 9.0.8)
- Microsoft.Extensions.Hosting.Abstractions (>= 9.0.8)
- Microsoft.Extensions.Logging.Abstractions (>= 9.0.8)
- Microsoft.Extensions.Options (>= 9.0.8)
- Microsoft.Extensions.Options.DataAnnotations (>= 9.0.8)
- System.IO.Hashing (>= 9.0.8)
- System.Linq.Async (>= 6.0.3)
- System.Reactive (>= 6.0.1)
NuGet packages (11)
Showing the top 5 NuGet packages that depend on HighTechInnovators.RxDatasets:
| Package | Downloads |
|---|---|
|
HighTechInnovators.RxDatasets.StorageProvider.Minio
A set of libraries that allow the development of Reactive Dataset-servers, using protobuf files a backing storage. Inspired by Netflix Hollow. |
|
|
HighTechInnovators.RxDatasets.StorageProvider.AzBlob
A set of libraries that allow the development of Reactive Dataset-servers, using protobuf files a backing storage. Inspired by Netflix Hollow. |
|
|
HighTechInnovators.RxDatasets.InMemoryDataset
A set of libraries that allow the development of Reactive Dataset-servers, using protobuf files a backing storage. Inspired by Netflix Hollow. |
|
|
HighTechInnovators.RxDatasets.StorageProvider.S3
A set of libraries that allow the development of Reactive Dataset-servers, using protobuf files a backing storage. Inspired by Netflix Hollow. |
|
|
HighTechInnovators.RxDatasets.Reporting
A set of libraries that allow the development of Reactive Dataset-servers, using protobuf files a backing storage. Inspired by Netflix Hollow. |
GitHub repositories
This package is not used by any popular GitHub repositories.
| Version | Downloads | Last Updated |
|---|---|---|
| 0.14.0 | 336 | 10/29/2025 |
| 0.13.0 | 293 | 10/28/2025 |
| 0.13.0-dev.6 | 141 | 9/11/2025 |
| 0.12.3 | 358 | 9/30/2025 |
| 0.12.3-dev.1-gcsratefix.1 | 143 | 9/29/2025 |
| 0.12.2 | 391 | 9/19/2025 |
| 0.12.1 | 445 | 9/2/2025 |
| 0.12.0 | 300 | 8/21/2025 |
| 0.12.0-dev.5 | 120 | 8/20/2025 |
| 0.11.0 | 400 | 8/5/2025 |
| 0.11.0-dev.7-fix44.4 | 212 | 8/5/2025 |
| 0.11.0-dev.7-fix44.3 | 203 | 8/5/2025 |
| 0.11.0-dev.7-fix44.2 | 218 | 8/5/2025 |
| 0.11.0-dev.23 | 205 | 8/5/2025 |
| 0.10.0 | 399 | 4/17/2025 |
| 0.9.1 | 305 | 3/20/2025 |
| 0.9.0 | 316 | 3/19/2025 |
| 0.1.0-dev.324 | 144 | 3/19/2025 |
| 0.1.0-dev.280 | 91 | 1/28/2025 |
| 0.1.0-dev.274 | 98 | 1/22/2025 |
| 0.1.0-dev.273 | 77 | 1/22/2025 |
| 0.1.0-dev.272 | 78 | 1/22/2025 |
| 0.1.0-dev.260 | 70 | 1/22/2025 |
| 0.1.0-dev.250 | 82 | 1/21/2025 |
| 0.1.0-dev.244 | 80 | 1/21/2025 |
| 0.1.0-dev.224 | 129 | 12/12/2024 |
| 0.1.0-dev.220 | 95 | 12/12/2024 |
| 0.1.0-dev.212 | 92 | 11/11/2024 |
| 0.1.0-dev.197 | 77 | 11/7/2024 |
| 0.1.0-dev.149 | 79 | 10/3/2024 |
| 0.1.0-dev.137 | 84 | 9/26/2024 |
| 0.1.0-dev.135 | 75 | 9/25/2024 |
| 0.1.0-dev.133 | 78 | 9/25/2024 |
| 0.1.0-dev.121 | 87 | 9/24/2024 |
| 0.1.0-dev.71 | 88 | 9/6/2024 |
| 0.1.0-dev.65 | 77 | 8/30/2024 |
| 0.1.0-dev.64 | 85 | 8/30/2024 |
| 0.1.0-dev.62 | 80 | 8/30/2024 |
| 0.1.0-dev.52.jsonoutput.7 | 107 | 8/21/2024 |
| 0.1.0-dev.52.jsonoutput.6 | 89 | 8/20/2024 |
| 0.1.0-dev.52.jsonoutput.5 | 85 | 8/20/2024 |
| 0.1.0-dev.40 | 108 | 7/25/2024 |
| 0.1.0-dev.37 | 80 | 7/24/2024 |
| 0.1.0-dev.29 | 102 | 7/22/2024 |
| 0.1.0-dev.27 | 82 | 7/19/2024 |
| 0.1.0-dev.25.addS3Implement... | 72 | 7/19/2024 |
| 0.1.0-dev.22.different-ensu... | 93 | 7/19/2024 |
| 0.1.0-dev.21 | 92 | 7/18/2024 |
| 0.1.0-dev.19 | 89 | 7/17/2024 |
| 0.1.0-dev.17 | 78 | 7/15/2024 |
| 0.0.1-uploadtest.2 | 110 | 7/15/2024 |
| 0.0.1-uploadtest.1 | 80 | 7/15/2024 |