AIOMux.Clients 0.5.0

dotnet add package AIOMux.Clients --version 0.5.0
                    
NuGet\Install-Package AIOMux.Clients -Version 0.5.0
                    
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="AIOMux.Clients" Version="0.5.0" />
                    
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="AIOMux.Clients" Version="0.5.0" />
                    
Directory.Packages.props
<PackageReference Include="AIOMux.Clients" />
                    
Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add AIOMux.Clients --version 0.5.0
                    
#r "nuget: AIOMux.Clients, 0.5.0"
                    
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package AIOMux.Clients@0.5.0
                    
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=AIOMux.Clients&version=0.5.0
                    
Install as a Cake Addin
#tool nuget:?package=AIOMux.Clients&version=0.5.0
                    
Install as a Cake Tool

AIOMux.Clients

AIOMux.Clients is a modern .NET library providing client implementations for interacting with Language Models in agent-based systems. It is designed to work seamlessly with AIOMux.Core, enabling you to integrate, orchestrate, and scale LLM-powered agents in your applications.

Key Features

  • OllamaClient: Easy integration with local Ollama LLM server
  • Rate limiting: Prevents excessive requests to LLM endpoints
  • Extensible architecture: Add new LLM clients as needed
  • Async API: All LLM operations are asynchronous for scalability
  • More clients coming soon (e.g., OpenAI, etc.)

Getting Started

Prerequisites

  • .NET 8+
  • Ollama server running locally (default: http://localhost:11434)

Example: Basic Usage

using AIOMux.Clients;

var llm = new OllamaClient(model: "llama3");
string response = await llm.GenerateAsync("What is the capital of France?");
Console.WriteLine(response);

Example: Chat Loop

using AIOMux.Clients;

var llm = new OllamaClient(model: "llama3.1");
while (true)
{
    Console.Write("You: ");
    string? input = Console.ReadLine();
    if (string.IsNullOrWhiteSpace(input) || input.Trim().ToLower() == "exit")
        break;
    string response = await llm.GenerateAsync(input);
    Console.WriteLine($"AI: {response}");
}

API Overview

OllamaClient

  • OllamaClient(string model = "llama3", int maxRequestsPerMinute = 60)
  • Task<string> GenerateAsync(string prompt) � Generate a response from the LLM
  • Task<string> CompleteAsync(string userInput, string systemPrompt) � Generate a completion with a system prompt

Extending

You can add new LLM clients by implementing the ILLMClient interface from AIOMux.Core.

License

This project is licensed under the MIT License. See LICENSE for details.

Product Compatible and additional computed target framework versions.
.NET net8.0 is compatible.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed.  net9.0 was computed.  net9.0-android was computed.  net9.0-browser was computed.  net9.0-ios was computed.  net9.0-maccatalyst was computed.  net9.0-macos was computed.  net9.0-tvos was computed.  net9.0-windows was computed.  net10.0 was computed.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
0.5.0 136 9/2/2025
0.4.0 136 9/1/2025

Minor updates.