redb.Route.GenericFile 2.0.2

redb.Route.GenericFile

Shared base library for file-based transports in the redb.Route ESB framework.
Provides abstract consumer, producer, options, and file-operations interfaces that concrete transports (File, FTP, SFTP) inherit from. Not used directly — include one of the transport-specific packages instead.

Architecture

GenericFileEndpointOptions          ← base options (polling, filtering, producer write)
 └─ RemoteFileEndpointOptions       ← + host/port/auth/reconnect

GenericFileConsumer<TOptions>       ← template-method poll loop
 └─ RemoteFileConsumer<TOptions>    ← + connect/reconnect lifecycle

GenericFileProducer<TOptions>       ← template-method write flow
 └─ RemoteFileProducer<TOptions>    ← + connect/reconnect lifecycle

IFileOperations                     ← protocol abstraction (list, read, write, move, delete)
 └─ IRemoteFileOperations           ← + connect/disconnect

Transport implementations (File, Ftp, Sftp) provide concrete IFileOperations and transport-specific headers/DSL. All polling logic, filtering, idempotency, post-processing, atomic write, and file-exist strategies are implemented in this base library.

Consumer Pipeline

The GenericFileConsumer runs a poll loop with the following steps:

1. List files in the base directory (optionally recursive)
2. Filter — exclude temp/internal files (.redb_*, temp prefix), apply glob include/exclude patterns
3. Sort — by name, date, or size (ascending or descending)
4. Limit — apply maxMessagesPerPoll
5. Per-file checks — minAge, maxAge, done-file presence, idempotency repository
6. Pre-move — optionally move to a staging directory before processing
7. Read body — as byte[] (default) or Stream (streamBody=true)
8. Invoke processor — pass exchange to the downstream pipeline
9. Post-process — Noop (leave in place) / Delete / MoveTo
10. Confirm — mark idempotent key, delete done file

On processing failure: remove idempotent key, move to moveFailed directory (if configured).

Producer Pipeline

The GenericFileProducer writes files with atomic temp-then-rename:

1. Resolve body — from exchange.Out (if set) or exchange.In
2. Resolve target path — from FileName option / header / auto-generated GUID
3. Validate path — jail-directory check (transport-specific)
4. Create directories — if autoCreate=true
5. Write to temp file — using tempPrefix or tempFileName
6. Handle existing — apply fileExist strategy (Override / Append / Fail / Ignore / Move / TryRename)
7. Atomic rename — move temp file to target
8. Cleanup — delete temp file on failure

Options Reference

GenericFileEndpointOptions (Base)

Consumer / Polling

Consumer / Post-Processing

Only one of Noop, Delete, MoveTo can be set.

Consumer / Idempotency

Default idempotent key: "{fullPath}|{lastModifiedUtc:O}|{length}".

Consumer / Body

Producer

RemoteFileEndpointOptions (extends Base)

Connection

Reconnection

Consumer-Specific

Enums

GenericFileExistStrategy

GenericFileSortBy

File Operations Interface

Transport implementations provide IFileOperations (or IRemoteFileOperations for network transports):

• ListFilesAsync — enumerate files in a directory
• ReadAllBytesAsync / OpenReadAsync — read file contents
• WriteAsync (byte[] / Stream) / AppendAsync / AppendTextAsync — write
• ExistsAsync / DeleteAsync / MoveAsync — file operations
• CreateDirectoryAsync / DirectoryExistsAsync — directory operations
• Path helpers: CombinePath, GetParentPath, GetFileName, GetExtension, etc.

Glob Patterns

Include/exclude patterns support comma-separated values and */? wildcards:

*.csv          — all CSV files
*.csv,*.xml    — CSV and XML files
report_*       — files starting with "report_"
data?.txt      — data1.txt, dataA.txt, etc.

Done File Substitutions

Requirements

• .NET 8.0 / 9.0 / 10.0
• redb.Route (core) — no external dependencies