FilePipelineNET 2.1013.2233

Introducing FilePipelineNET

We present the FilePipelineNET Library, a robust and efficient solution designed to streamline the handling and processing of incoming files. This library automatically monitors a designated folder (referred to as inletDirectoryFullName) for new file arrivals, processes their contents, and then archives them in an organized manner.

Key Features

• Automatic File Monitoring:
  The library continuously monitors the specified inletDirectoryFullName for incoming files. When a file is dropped into this directory, it is automatically detected and queued for processing.

• Customizable Processing with fileDelegate:
  Once a file is detected, it is processed using custom logic defined through the fileDelegate delegate. This delegate allows you to inject your specific processing logic, whether it's parsing data, transforming formats, validating contents, or performing any other custom operation you need.

• Organized Archiving:
  After processing, the library moves each file to a subfolder within the original directory, naming it with a timestamp to reflect the date of processing. This ensures that processed files are kept organized and easily traceable.

How It Works

1. File Arrival: A file is placed into the inletDirectoryFullName.
2. Processing: The library triggers the fileDelegate delegate for each file, executing the custom processing logic you've defined.
3. Archiving: Once processed, the file is archived into a new subfolder within the original directory. The subfolder is automatically named with the current date (e.g., Processed_2025-10-12).

Use Cases

This library is ideal for scenarios involving automated workflows, data ingestion pipelines, or any use case where incoming files need to be processed and stored in an organized manner.

With the File Processor .NET Library, you can automate repetitive tasks, reduce manual handling, and keep your file processing efficient and organized, all while maintaining full control over how each file is processed.

Example Code

Below is a simple example of how to use the library, including setting up the fileDelegate for custom processing:

namespace Example
{
    internal class Program
    {
        static void Main(string[] args)
        {
            using (FilePipeline filePipeline = new FilePipeline(
                    instanceName: "MyFilePipeline",
                    inletDirectoryFullName: @"C:\incoming_files",
                    outletDirectoryName: "history_sub_folder",
                    fileSubfix: "*.json",
                    retentionDays: 7,
                    adminDelegate: (httpContext) => { return false; },
                    traceDelegate: (instanceName, logLevel, message) => { Console.WriteLine(message); },
                    fileDelegate: (instanceName, file) =>
                    {
                        string json = System.Text.Encoding.Default.GetString(file.Contents);
                        /// TODO: your json processing logic here.
                        file.ArchiveTag = "DONE";
                    }
                    ))
                {
                    Console.WriteLine("Press ENTER to stop ...")
                    Console.ReadLine();
                }
        }
    }
}