Themis.Inference.OpenVINO
1.7.0
dotnet add package Themis.Inference.OpenVINO --version 1.7.0
NuGet\Install-Package Themis.Inference.OpenVINO -Version 1.7.0
<PackageReference Include="Themis.Inference.OpenVINO" Version="1.7.0" />
<PackageVersion Include="Themis.Inference.OpenVINO" Version="1.7.0" />
<PackageReference Include="Themis.Inference.OpenVINO" />
paket add Themis.Inference.OpenVINO --version 1.7.0
#r "nuget: Themis.Inference.OpenVINO, 1.7.0"
#:package Themis.Inference.OpenVINO@1.7.0
#addin nuget:?package=Themis.Inference.OpenVINO&version=1.7.0
#tool nuget:?package=Themis.Inference.OpenVINO&version=1.7.0
Themis.Inference.OpenVINO
Themis.Inference.OpenVINO adds the Intel OpenVINO ONNX Runtime execution
provider as an optional package. It uses Themis' existing ONNX model bundles
and decision contracts; it does not add a new model format or model-output
mapping.
Install the package and register it alongside the normal Themis services:
services.AddThemis(options => options.Model = "laya-production");
services.AddThemisOpenVINO();
The default configuration requires an available GPU or NPU and reports an
error rather than silently falling back to CPU. Pass an
InferenceRuntimeConfiguration with PreferAccelerator to use the OpenVINO
accelerator when available and otherwise allow ONNX Runtime's default path.
RequireGpu requires a GPU rather than an NPU.
The upstream plugin package currently includes native assets for Windows x64
and Linux x64. This Themis integration targets net10.0; validate the exact
operating system, runtime identifier, Intel device, driver, and model before
relying on accelerator execution. A registered provider or successful
inference call alone does not prove that model nodes ran on the requested
device. Publish consumers with the matching win-x64 or linux-x64 runtime
identifier so the native plugin assets are included. The OpenVINO hardware
integration test is inconclusive when its required GPU/NPU is unavailable.
The plugin is supplied by Intel.ML.OnnxRuntime.EP.OpenVINO (MIT). Review its
license and the device-specific OpenVINO requirements for your deployment.
| Product | Versions Compatible and additional computed target framework versions. |
|---|---|
| .NET | net10.0 is compatible. net10.0-android was computed. net10.0-browser was computed. net10.0-ios was computed. net10.0-maccatalyst was computed. net10.0-macos was computed. net10.0-tvos was computed. net10.0-windows was computed. |
-
net10.0
- Intel.ML.OnnxRuntime.EP.OpenVINO (>= 1.8.0)
- Microsoft.Extensions.DependencyInjection.Abstractions (>= 10.0.13)
- Themis.Core (>= 1.7.0)
- Themis.Inference (>= 1.7.0)
NuGet packages
This package is not used by any NuGet packages.
GitHub repositories
This package is not used by any popular GitHub repositories.