TIEG.SystemOne.LLamaSharp 1.0.0

.NET 8.0

dotnet add package TIEG.SystemOne.LLamaSharp --version 1.0.0

NuGet\Install-Package TIEG.SystemOne.LLamaSharp -Version 1.0.0

This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.

<PackageReference Include="TIEG.SystemOne.LLamaSharp" Version="1.0.0" />

For projects that support PackageReference, copy this XML node into the project file to reference the package.

<PackageVersion Include="TIEG.SystemOne.LLamaSharp" Version="1.0.0" />
                    

                            Directory.Packages.props

<PackageReference Include="TIEG.SystemOne.LLamaSharp" />
                    

                            Project file

For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.

paket add TIEG.SystemOne.LLamaSharp --version 1.0.0

The NuGet Team does not provide support for this client. Please contact its maintainers for support.

#r "nuget: TIEG.SystemOne.LLamaSharp, 1.0.0"

#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.

#:package TIEG.SystemOne.LLamaSharp@1.0.0

#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.

#addin nuget:?package=TIEG.SystemOne.LLamaSharp&version=1.0.0
                    

                            Install as a Cake Addin

#tool nuget:?package=TIEG.SystemOne.LLamaSharp&version=1.0.0
                    

                            Install as a Cake Tool

The NuGet Team does not provide support for this client. Please contact its maintainers for support.

TIEG.SystemOne.LLamaSharp

A high-performance, deterministic routing engine for local AI models, built for LLamaSharp. Developed by The Intelligent Enterprise Group (TIEG).

This library implements a "System One" architectural pattern. Instead of generating text autoregressively (which takes seconds), it extracts raw logits from a single parallel batch pass to determine the probability of specific categories.

This allows smaller models (like Plumb-4B or Qwen) to execute deterministic classification in < 100ms while saving your VRAM for larger fallback models.

Features

Instant Execution: Bypass token-by-token generation for sub-100ms classification.
Universal Thresholds: Uses Margin and Dominance Ratios to evaluate the model's internal hesitation, ensuring mathematical safety across 2-option and 10-option questions.
VRAM Safety: Includes thread-locking and explicit Unload() memory management to prevent out-of-memory exceptions when hot-swapping models.

Quick Start

using TIEG.SystemOne.LLamaSharp;

// Initialize the engine
using var engine = new DecisionEngine("path/to/model.gguf");

// Execute a classification in < 100ms
var result = engine.Decide(
    systemContext: "Determine the risk level of the transaction.",
    inputData: "Transaction: $12 Netflix subscription.",
    options: new[] { "High Risk", "Medium Risk", "Low Risk" }
);

if (result.CanAutomate(minMargin: 0.20f, minDominanceRatio: 3.0f))
{
    Console.WriteLine($"Automated: {result.SelectedOption}");
}
else
{
    engine.Unload(); // Free VRAM
    // ... route to a heavy fallback model
}

Product	Compatible and additional computed target framework versions.
.NET	net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed.

Product

.NET

Compatible target framework(s)

Included target framework(s) (in package)

Learn more about Target Frameworks and .NET Standard.

net8.0
- LLamaSharp (>= 0.27.0)
- Microsoft.Extensions.Logging (>= 8.0.1)

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.