Agash.StreamTransport.Codecs.FFmpeg 0.2.0-dev2

This is a prerelease version of Agash.StreamTransport.Codecs.FFmpeg.
There is a newer prerelease version of this package available.
See the version list below for details.
dotnet add package Agash.StreamTransport.Codecs.FFmpeg --version 0.2.0-dev2
                    
NuGet\Install-Package Agash.StreamTransport.Codecs.FFmpeg -Version 0.2.0-dev2
                    
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="Agash.StreamTransport.Codecs.FFmpeg" Version="0.2.0-dev2" />
                    
For projects that support PackageReference, copy this XML node into the project file to reference the package.
<PackageVersion Include="Agash.StreamTransport.Codecs.FFmpeg" Version="0.2.0-dev2" />
                    
Directory.Packages.props
<PackageReference Include="Agash.StreamTransport.Codecs.FFmpeg" />
                    
Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package.
paket add Agash.StreamTransport.Codecs.FFmpeg --version 0.2.0-dev2
                    
#r "nuget: Agash.StreamTransport.Codecs.FFmpeg, 0.2.0-dev2"
                    
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
#:package Agash.StreamTransport.Codecs.FFmpeg@0.2.0-dev2
                    
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package.
#addin nuget:?package=Agash.StreamTransport.Codecs.FFmpeg&version=0.2.0-dev2&prerelease
                    
Install as a Cake Addin
#tool nuget:?package=Agash.StreamTransport.Codecs.FFmpeg&version=0.2.0-dev2&prerelease
                    
Install as a Cake Tool

Agash.StreamTransport.Codecs.FFmpeg

H.264, H.265 and AV1 video encoders and decoders for Agash.StreamTransport, on FFmpeg 9 through FFmpeg.Interop. They implement the IVideoEncoderFactory and IVideoDecoderFactory contracts of Agash.StreamTransport.Media, so a pipeline asks each factory what it can do on which GPU and picks the best.

Backends

Encoders Takes without a copy Platforms
D3D12 (Direct3D 12 Video Encode, any vendor) Direct3D 12 textures Windows
Nvenc, Amf Direct3D 11 textures (copied on the GPU into the encoder's surfaces) Windows; NVENC also Linux
Qsv system memory Windows, Linux
Vulkan (Vulkan Video) system memory Windows, Linux
Vaapi DMA-BUFs Linux
VideoToolbox IOSurfaces macOS
MediaFoundation system memory Windows
Software (OpenH264, kvazaar, SVT-AV1) system memory all
Decoders Produces Platforms
D3D12, D3D11 Direct3D 12 or 11 textures Windows
Vaapi DMA-BUFs Linux
Vulkan system memory Windows, Linux
VideoToolbox IOSurfaces macOS
Software (libavcodec, dav1d) system memory all

FFmpegVideoProcessorFactory converts frames in system memory (pixel format, size, colour) on swscale. It ranks below the GPU processors of the platform packages and serves as the fallback.

Modern APIs rank first where there is a choice: Direct3D 12 ahead of the Direct3D 11 vendor paths, Vulkan ahead of VA-API. Every backend takes system memory as well.

Behaviour

  • Each factory opens a real encoder or decoder once per codec and GPU and pushes frames through it. A backend whose driver lacks the codec, whose GPU is missing, or that falls back to software reports no capabilities.
  • Encoders run with no reordering or lookahead, and constant bit rate under a rate-control buffer sized for the tuning (interactive, screen content, loss resilient). FFmpeg rejects an option an encoder does not know, so a renamed option fails the open.
  • Congestion control reaches every backend. NVENC and Quick Sync take a rate change between frames; the other encoders reopen at the next frame, starting with a keyframe, once the target has moved far enough from their rate to be worth it (15% down or 30% up).
  • Every backend honours keyframe requests. An encoder that ignores a forced picture type is reopened for the keyframe.
  • Decoded frames are views over FFmpeg's buffers or surfaces. Retaining one takes a reference to them.
  • The stream signals the configuration's colour, or the first frame's, or BT.709 when neither gives one.
  • FFmpeg's own log goes to the container's logging, under FFmpeg.* categories, for as long as the container lives (FFmpegCodecOptions.RouteFFmpegLog turns this off). What FFmpeg logs while a backend is probed is demoted to Debug; the probe's outcome is logged by the factory.

Diagnostics

The meter Agash.StreamTransport.Codecs.FFmpeg (FFmpegCodecDiagnostics.MeterName), from the host's IMeterFactory with DI, tagged with streamtransport.ffmpeg.codec:

Instrument Unit What
streamtransport.ffmpeg.encoder.opens {open} encoders opened, by streamtransport.reason: start, rate, frame_rate, keyframe, storage; every open after the start costs a keyframe
streamtransport.ffmpeg.encoder.open.duration s time to open an encoder
streamtransport.ffmpeg.probes {probe} encoders and decoders tried at first use, by streamtransport.outcome: works or unavailable

Capture devices

FFmpegVideoInputProvider reaches cameras through FFmpeg's capture devices (dshow, v4l2, avfoundation). It ranks below the platform providers: a camera they list is opened by them, and by FFmpeg when they cannot open it. It decodes cameras that send only MJPEG, and reaches DirectShow-only virtual cameras on Windows.

Native libraries

The package depends on FFmpeg.Interop.Native, which carries the FFmpeg 9 shared libraries per runtime (runtimes/<rid>/native), each with its build's licence: FFmpeg.Interop's own build, from pinned upstream sources, for Windows, Linux and macOS on x64 and arm64. It has every hardware codec API the platform offers (D3D11VA, D3D12VA, Media Foundation, NVENC and NVDEC, AMF, QSV, VA-API, Vulkan Video, V4L2 M2M, Rockchip MPP, VideoToolbox), the LGPL software codecs, and FFmpeg's DMA-BUF synchronisation on Linux. It is LGPL 2.1, or LGPL 3 on linux-arm64 for Rockchip's MPP; the GPL x264 and x265 are left out.

Product Compatible and additional computed target framework versions.
.NET net11.0 is compatible. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated
0.2.0-dev5 60 11/11/2026
0.2.0-dev4 90 11/3/2026
0.2.0-dev3 75 11/3/2026
0.2.0-dev2 316 11/2/2026
0.2.0-dev1 73 11/2/2026