AIOMux.Clients
0.5.0
dotnet add package AIOMux.Clients --version 0.5.0
NuGet\Install-Package AIOMux.Clients -Version 0.5.0
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="AIOMux.Clients" Version="0.5.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="AIOMux.Clients" Version="0.5.0" />
<PackageReference Include="AIOMux.Clients" />
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add AIOMux.Clients --version 0.5.0
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
#r "nuget: AIOMux.Clients, 0.5.0"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package AIOMux.Clients@0.5.0
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=AIOMux.Clients&version=0.5.0
#tool nuget:?package=AIOMux.Clients&version=0.5.0
The NuGet Team does not provide support for this client. Please contact its maintainers for support.
AIOMux.Clients
AIOMux.Clients is a modern .NET library providing client implementations for interacting with Language Models in agent-based systems. It is designed to work seamlessly with AIOMux.Core, enabling you to integrate, orchestrate, and scale LLM-powered agents in your applications.
Key Features
- OllamaClient: Easy integration with local Ollama LLM server
- Rate limiting: Prevents excessive requests to LLM endpoints
- Extensible architecture: Add new LLM clients as needed
- Async API: All LLM operations are asynchronous for scalability
- More clients coming soon (e.g., OpenAI, etc.)
Getting Started
Prerequisites
- .NET 8+
- Ollama server running locally (default:
http://localhost:11434
)
Example: Basic Usage
using AIOMux.Clients;
var llm = new OllamaClient(model: "llama3");
string response = await llm.GenerateAsync("What is the capital of France?");
Console.WriteLine(response);
Example: Chat Loop
using AIOMux.Clients;
var llm = new OllamaClient(model: "llama3.1");
while (true)
{
Console.Write("You: ");
string? input = Console.ReadLine();
if (string.IsNullOrWhiteSpace(input) || input.Trim().ToLower() == "exit")
break;
string response = await llm.GenerateAsync(input);
Console.WriteLine($"AI: {response}");
}
API Overview
OllamaClient
OllamaClient(string model = "llama3", int maxRequestsPerMinute = 60)
Task<string> GenerateAsync(string prompt)
� Generate a response from the LLMTask<string> CompleteAsync(string userInput, string systemPrompt)
� Generate a completion with a system prompt
Extending
You can add new LLM clients by implementing the ILLMClient
interface from AIOMux.Core.
License
This project is licensed under the MIT License. See LICENSE for details.
Product | Versions Compatible and additional computed target framework versions. |
---|---|
.NET | net8.0 is compatible. net8.0-android was computed. net8.0-browser was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed. net9.0 was computed. net9.0-android was computed. net9.0-browser was computed. net9.0-ios was computed. net9.0-maccatalyst was computed. net9.0-macos was computed. net9.0-tvos was computed. net9.0-windows was computed. net10.0 was computed. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.
-
net8.0
- AIOMux.Core (>= 0.3.0)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.
Minor updates.