Darkspyre.Inference.Tensor.Embedding
11.20.0
Prefix Reserved
dotnet add package Darkspyre.Inference.Tensor.Embedding --version 11.20.0
NuGet\Install-Package Darkspyre.Inference.Tensor.Embedding -Version 11.20.0
<PackageReference Include="Darkspyre.Inference.Tensor.Embedding" Version="11.20.0" />
<PackageVersion Include="Darkspyre.Inference.Tensor.Embedding" Version="11.20.0" />
<PackageReference Include="Darkspyre.Inference.Tensor.Embedding" />
paket add Darkspyre.Inference.Tensor.Embedding --version 11.20.0
#r "nuget: Darkspyre.Inference.Tensor.Embedding, 11.20.0"
#:package Darkspyre.Inference.Tensor.Embedding@11.20.0
#addin nuget:?package=Darkspyre.Inference.Tensor.Embedding&version=11.20.0
#tool nuget:?package=Darkspyre.Inference.Tensor.Embedding&version=11.20.0
Darkspyre.Inference.Tensor.Embedding
Text embeddings from GGUF sentence encoders inside the application's process, through TensorSharp. The engine
implements Common's IEmbeddingInference and returns unit-length vectors.
Install
dotnet add package Darkspyre.Inference.Tensor.Embedding --prerelease
Register
Construct TensorEmbeddingInference over a TensorModelPackManager, or call AddTensorEngines() from
Darkspyre.Inference.Tensor.Registry, which registers EmbeddingEngineProvider. Models arrive by import: the package
has no built-in pack.
Example
Register the imported pack in the manager's catalog and install it through packs.InstallAsync(modelKey) when the
person chooses to acquire it. The following load uses that installed pack.
await using var embeddings = new TensorEmbeddingInference(packs);
await embeddings.StartAsync();
await embeddings.LoadAsync(modelKey); // Accepts loading, not completion.
Subscribe to EngineStatusChanged before loading. After it reports Loaded, make requests; handle Failed instead of
sending a request after a failed load. Awaiting LoadAsync alone does not wait for Loaded.
EmbeddingResult result = await embeddings.EmbedAsync(new EmbeddingRequest
{
ModelId = modelKey.ModelId,
Kind = EmbeddingInputKind.Query,
Inputs = [new TextEmbeddingInput("Where did the meeting move?")]
});
The engine formats queries itself; documents are embedded as given. A query request runs before waiting document requests.
Settings
EmbeddingSetup.CreateSettingsManager opens the engine's settings: the model with its install state, "Runs on", the
fields that import a model, and the download, check, load and backend-check actions.
Limits
- A model must be a BERT embedding GGUF (mean, CLS or last-token pooling) with 1,024 dimensions and at least an 8,192-token context. A Qwen3-Embedding pack is reported as not supported.
- The engine runs on managed CPU and GGML CPU, and shares the process's GGML runtime through
Darkspyre.Inference.Tensor.Ggml. - Text only: a request with a media input fails with
UnsupportedFeaturebefore the model runs. - An input over the limit fails the request with
EmbeddingInputTooLongException, unless the request setsTruncate. - A smaller requested size (256) keeps the vector's leading values and scales them back to unit length.
- Vectors with different
ModelFingerprintvalues are not comparable.
The Darkspyre.Inference packages
This package is one library of the Darkspyre.Inference family. The family runs AI inference from .NET applications through typed, provider-neutral contracts.
Darkspyre.Inference.Commonholds the contracts every other package shares: requests, results, capabilities, failures and the provider setup model.Darkspyre.Inference.Connect.Commonholds the conversation and embedding services. Each Connect provider package adds one provider, andAddLlmConnect()discovers every provider package the application references.- The Tensor packages load and run models inside the application's own process.
- The UI.Settings packages provide the setup editors a host places in its own window or page.
Every package of the family carries the same version. Reference all of them at the same version: each package depends on the exact version of the family packages it uses.
The packages are licensed under the MIT license. LICENSE.md in each package holds the license text.
| Package | Holds |
|---|---|
| Darkspyre.Inference.Common | Shared contracts for Connect and Tensor |
| Darkspyre.Inference.Connect | Image, speech and audio connectors |
| Darkspyre.Inference.Connect.Common | Conversation and embedding services and provider discovery |
| Darkspyre.Inference.Connect.Codex | Conversations on a ChatGPT subscription |
| Darkspyre.Inference.Connect.Claude | Conversations on a Claude subscription through the Claude CLI |
| Darkspyre.Inference.Connect.HostTools | The host-tools local service and its client |
| Darkspyre.Inference.Connect.Antigravity | Conversations on a Google subscription through the Antigravity CLI |
| Darkspyre.Inference.Connect.Grok | Conversations on a Grok subscription |
| Darkspyre.Inference.Connect.Anthropic | Conversations through the Anthropic API with an API key, with hosted web search |
| Darkspyre.Inference.Connect.OpenAiApi | Conversations and embeddings through the OpenAI API |
| Darkspyre.Inference.Connect.SelfHost | Conversations and embeddings on engines the application runs |
| Darkspyre.Inference.Tensor.Common | Model packs, the model lifecycle and the Tensor capability interfaces |
| Darkspyre.Inference.Tensor.Decision.Laya | Laya typed decisions through ONNX Runtime |
| Darkspyre.Inference.Tensor.Embedding | Text embeddings from GGUF sentence encoders |
| Darkspyre.Inference.Tensor.Embedding.Gemma | EmbeddingGemma text and image embeddings |
| Darkspyre.Inference.Tensor.Ggml | The process's GGML and MLX native runtime |
| Darkspyre.Inference.Tensor.Image.Supra | Supra2-IMG image generation |
| Darkspyre.Inference.Tensor.LLM.Qwen | Qwen GGUF text generation |
| Darkspyre.Inference.Tensor.Registry | Registration and discovery of the Tensor engines |
| Darkspyre.Inference.Tensor.STT.Whisper | Whisper speech transcription |
| Darkspyre.Inference.UI.Settings.Core | Editor state and host contracts both setup editors share |
| Darkspyre.Inference.UI.Settings.Avalonia | The Avalonia setup editor |
| Darkspyre.Inference.UI.Settings.Blazor | The Blazor setup editor |
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net11.0 is compatible. |
-
net11.0
- Darkspyre.Inference.Common (= 11.20.0)
- Darkspyre.Inference.Tensor.Ggml (= 11.20.0)
- StbImageSharp (>= 2.30.15)
- TensorSharp.Backends.Cuda (>= 2026.10.11)
- TensorSharp.Backends.GGML (>= 2026.10.11)
- TensorSharp.Backends.MLX (>= 2026.10.11)
- TensorSharp.Models (>= 2026.10.11)
- TensorSharp.Runtime (>= 2026.10.11)
- TensorSharp.Tensors (>= 2026.10.11)
NuGet packages (1)
Showing the top 1 NuGet packages that depend on Darkspyre.Inference.Tensor.Embedding:
| Package | Downloads |
|---|---|
|
Darkspyre.Inference.Tensor.Registry
Registration, validation and ordered discovery of the Darkspyre Tensor engine implementations. |
GitHub repositories
This package is not used by any popular GitHub repositories.
| Version | Downloads | Last Updated |
|---|---|---|
| 11.20.0 | 60 | 11/15/2026 |
| 11.19.4-rc.3 | 79 | 11/6/2026 |
| 11.19.3-rc.3 | 64 | 11/5/2026 |
| 11.19.3-rc.2 | 78 | 10/31/2026 |
| 11.17.3-rc.2 | 95 | 10/26/2026 |