Benevia.Core.DataGenerator.LargeData 0.8.8

Benevia.Core.DataGenerator.LargeData

Overview

The Large Data Generator is a specialized tool for creating large volumes of test data in the Benevia ERP system. It's designed for load testing, performance testing, and integration testing scenarios where you need realistic amounts of data across multiple tenants.

Key Features

• Web-based UI: Easy-to-use interface for configuring and running data generation
• Tenant-specific: Generate data for specific tenants with custom configurations
• Time-range based: Create data for specific date ranges (month-based selection)
• Scalable: Configure the volume of data to generate per feature
• Dependency management: Features can depend on other features to ensure proper data relationships
• Authentication: Secure admin-only access with username/password authentication

Maintainers

• @dilshod06
• @dev-muhammad
• @alisherrik

Architecture Components

Core Classes

• LargeDataGenerator.cs — Main orchestrator for large-data generation and feature discovery
• LargeDataEndPoint.cs — HTTP endpoint controller for web-based data generation
• DataCreator.cs — Feature implementations that create large volumes of domain data
• ConfigStorage.cs — Configuration management for persisting large-data settings
• AuthService.cs — Authentication service for secure endpoint access
• ICreateLargeData.cs — Marker interface for large-data feature implementations

Web Interface

The system includes a sophisticated web UI accessible at /admin/large-data with the following features:

• Dark theme interface with modern gradient design
• Form-based configuration with persistent settings (stored in browser localStorage)
• Real-time validation with error highlighting
• Progress indicators during data generation
• Responsive design that works on mobile and desktop

UI Fields Explained

1. Base URL: The API endpoint URL (e.g., https://localhost:7140)
2. Username/Password: Admin credentials for authentication
3. Tenant ID: Target tenant for data generation (e.g., demo)
4. From/To Month: Date range for generated data using month pickers
5. Start Button: Initiates the data generation process
6. Reset Button: Clears all form fields and localStorage

Configuration Setup

2. Service Registration

Register the large data generator in your Program.cs:

// Register assemblies containing large-data features
builder.Services.ConfigureLargeData();

// Map the web UI endpoints
await app.Services.InitializeDataGeneratorAsync();

3. Endpoint Registration

The system automatically registers these endpoints:

• GET /admin/large-data - Web UI interface
• POST /admin/large-data/run - API endpoint for triggering generation

Usage Methods

Method 1: Web Interface (Recommended)

1. Start your application with the Large Data Generator endpoints enabled
2. Navigate to https://localhost:7140/admin/large-data in your browser
3. Fill in the configuration form:
   • Base URL: Your API endpoint
   • Username/Password: Admin credentials
   • Tenant ID: Target tenant identifier
   • Date Range: Select from/to months for data generation
4. Click Start to begin data generation
5. Monitor progress through the toast notifications

Creating Large Data Features

Basic Feature Implementation

Create a class that implements ICreateLargeData:

using Benevia.Core.API.Database;
using Benevia.Core.DataGenerator.LargeData;
using Benevia.Core.DataGenerator.LargeData.Attributes;
using Benevia.Core.DataGenerator.LargeData.Models;

namespace Your.Project.LargeData;

public class ProductLargeData : ICreateLargeData
{
    public void CreateLargeData(IDataContext dataContext, DataCreator dataCreator, 
        DataFaker faker, DateTime startDate, DateTime endDate)
    {
        // Generate large volumes of products
        for (int i = 0; i < 1000; i++)
        {
            var product = new Product
            {
                Name = faker.Commerce.ProductName(),
                Description = faker.Commerce.ProductDescription(),
                Price = faker.Random.Decimal(1, 1000),
                CreatedDate = faker.Date.Between(startDate, endDate)
            };
            
            dataCreator.Create(product, nameof(Product));
        }
    }
}

Advanced Feature with Dependencies

Use the [DependsOn] attribute to ensure proper execution order:

[DependsOn(nameof(CustomerLargeData))]  // Ensure customers exist first
public class SalesLargeData : ICreateLargeData
{
    public void CreateLargeData(IDataContext dataContext, DataCreator dataCreator, 
        DataFaker faker, DateTime startDate, DateTime endDate)
    {
        // Get existing customers created by CustomerLargeData
        var customers = dataContext.GetEntities<Customer>().ToList();
        
        foreach (var customer in customers.Take(100))
        {
            // Create sales orders for each customer
            var salesOrder = new SalesOrder
            {
                CustomerGuid = customer.Guid,
                OrderDate = DateOnly.FromDateTime(faker.Date.Between(startDate, endDate)),
                Total = faker.Random.Decimal(100, 5000)
            };
            
            dataCreator.Create(salesOrder, nameof(SalesOrder));
        }
    }
}