Lightweight.Caching 0.9.0

.NET Standard 2.0 This package targets .NET Standard 2.0. The package is compatible with this framework or higher.
The owner has unlisted this package. This could mean that the package is deprecated, has security vulnerabilities or shouldn't be used anymore. 
dotnet add package Lightweight.Caching --version 0.9.0
                    


                    

                
NuGet\Install-Package Lightweight.Caching -Version 0.9.0
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package. 
<PackageReference Include="Lightweight.Caching" Version="0.9.0" />
For projects that support PackageReference, copy this XML node into the project file to reference the package. 
<PackageVersion Include="Lightweight.Caching" Version="0.9.0" />
                    


                            Directory.Packages.props
                        

                    

                
<PackageReference Include="Lightweight.Caching" />
                    


                            Project file
For projects that support Central Package Management (CPM), copy this XML node into the solution Directory.Packages.props file to version the package. 
paket add Lightweight.Caching --version 0.9.0
                    


                    

                
#r "nuget: Lightweight.Caching, 0.9.0"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package. 
#:package Lightweight.Caching@0.9.0
#:package directive can be used in C# file-based apps starting in .NET 10 preview 4. Copy this into a .cs file before any lines of code to reference the package. 
#addin nuget:?package=Lightweight.Caching&version=0.9.0
                    


                            Install as a Cake Addin
                        

                    

                
#tool nuget:?package=Lightweight.Caching&version=0.9.0
                    


                            Install as a Cake Tool

⚡ Lightweight.Caching

A collection of lightweight caching primitives.

LRU implementations are intended as an alternative to the System.Runtime.Caching.MemoryCache family of classes (e.g. HttpRuntime.Cache, System.Web.Caching et. al.). MemoryCache makes heap allocations when the native object key is not type string, and does not offer the fastest possible performance.

NuGet version

Overview

Class Example use
ClassicLru Bounded size LRU based with strict ordering.<br><br>Use if ordering is important, but data structures are synchronized with a lock which limits scalability.
ConcurrentLru Bounded size pseudo LRU.<br><br>For when you want a ConcurrentDictionary, but with bounded size. Maintains psuedo order, but is faster than ClassicLru and not prone to lock contention.
ConcurrentTlru Bounded size pseudo LRU, items have TTL.<br><br>Same as ConcurrentLru, but with a time aware least recently used (TLRU) eviction policy.
FastConcurrentLru/FastConcurrentTLru Same as ConcurrentLru/ConcurrentTLru, but with hit counting logic eliminated making them between 10 and 30% faster.
SingletonCache Cache singletons by key. Discard when not in use. <br><br> Cache a semaphore per user, where user population is large, but active user count is low.

Performance

ConcurrentLru Benchmarks

Lookup speed

The cache contains a single item which is repeatedly fetched. Results represent raw lookup speed.

BenchmarkDotNet=v0.12.1, OS=Windows 10.0.18363.900 (1909/November2018Update/19H2)
Intel Core i7-5600U CPU 2.60GHz (Broadwell), 1 CPU, 4 logical and 2 physical cores
.NET Core SDK=3.1.301
  [Host]    : .NET Core 3.1.5 (CoreCLR 4.700.20.26901, CoreFX 4.700.20.27001), X64 RyuJIT
  RyuJitX64 : .NET Core 3.1.5 (CoreCLR 4.700.20.26901, CoreFX 4.700.20.27001), X64 RyuJIT

Job=RyuJitX64  Jit=RyuJit  Platform=X64
Method Mean Error StdDev Ratio Gen 0 Allocated
DictionaryGetOrAdd 16.54 ns 0.359 ns 0.353 ns 1.00 - -
FastConcurrentLruGetOrAdd 22.98 ns 0.453 ns 0.719 ns 1.39 - -
ConcurrentLruGetOrAdd 32.96 ns 0.697 ns 1.544 ns 2.05 - -
FastConcurrentTLruGetOrAdd 118.62 ns 2.406 ns 3.746 ns 7.29 - -
ConcurrentTLruGetOrAdd 141.19 ns 3.454 ns 9.627 ns 8.41 - -
ClassicLruGetOrAdd 61.66 ns 2.215 ns 6.462 ns 3.69 - -
MemoryCacheGetStringKey 275.07 ns 5.461 ns 4.264 ns 16.73 0.0153 32 B

Lookup speed with queue cycling

Cache contains 6 items which are fetched repeatedly, no items are evicted. For LRU caches this measures time spent maintaining item access order.

BenchmarkDotNet=v0.12.1, OS=Windows 10.0.18363.900 (1909/November2018Update/19H2)
Intel Core i7-5600U CPU 2.60GHz (Broadwell), 1 CPU, 4 logical and 2 physical cores
.NET Core SDK=3.1.301
  [Host]    : .NET Core 3.1.5 (CoreCLR 4.700.20.26901, CoreFX 4.700.20.27001), X64 RyuJIT
  RyuJitX64 : .NET Core 3.1.5 (CoreCLR 4.700.20.26901, CoreFX 4.700.20.27001), X64 RyuJIT

Job=RyuJitX64  Jit=RyuJit  Platform=X64
Method Mean Error StdDev Ratio Gen 0 Allocated
ConcurrentDictionaryGetOrAdd 15.94 ns 0.308 ns 0.342 ns 1.00 - -
FastConcurrentLruGetOrAdd 22.01 ns 0.427 ns 0.555 ns 1.39 - -
ConcurrentLruGetOrAdd 32.98 ns 0.643 ns 1.038 ns 2.06 - -
FastConcurrentTLruGetOrAdd 120.79 ns 2.247 ns 3.994 ns 7.59 - -
ConcurrentTLruGetOrAdd 136.76 ns 2.619 ns 3.497 ns 8.60 - -
ClassicLruGetOrAdd 62.69 ns 1.054 ns 0.880 ns 3.93 - -
MemoryCacheGetStringKey 273.82 ns 2.970 ns 2.319 ns 17.14 0.0153 32 B

Meta-programming using structs for JIT dead code removal and inlining

TemplateConcurrentLru features injectable policies defined as structs. Since structs are subject to special optimizations by the JITter, the implementation is much faster than if these policies were defined as classes. Using this technique, lookups without TTL are within 15% of the speed of a ConcurrentDictionary.

Since DateTime.UtcNow is around 4x slower than a ConcurrentDictionary lookup, policies that involve time based expiry are significantly slower. Since these are injected as structs and the slow code is optimized away, it is possible maintain the fastest possible speed for the non-TTL policy.

Product Compatible and additional computed target framework versions.
.NET net5.0 was computed.  net5.0-windows was computed.  net6.0 was computed.  net6.0-android was computed.  net6.0-ios was computed.  net6.0-maccatalyst was computed.  net6.0-macos was computed.  net6.0-tvos was computed.  net6.0-windows was computed.  net7.0 was computed.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed.  net9.0 was computed.  net9.0-android was computed.  net9.0-browser was computed.  net9.0-ios was computed.  net9.0-maccatalyst was computed.  net9.0-macos was computed.  net9.0-tvos was computed.  net9.0-windows was computed.  net10.0 was computed.  net10.0-android was computed.  net10.0-browser was computed.  net10.0-ios was computed.  net10.0-maccatalyst was computed.  net10.0-macos was computed.  net10.0-tvos was computed.  net10.0-windows was computed. 
.NET Core netcoreapp2.0 was computed.  netcoreapp2.1 was computed.  netcoreapp2.2 was computed.  netcoreapp3.0 was computed.  netcoreapp3.1 was computed. 
.NET Standard netstandard2.0 is compatible.  netstandard2.1 was computed. 
.NET Framework net461 was computed.  net462 was computed.  net463 was computed.  net47 was computed.  net471 was computed.  net472 was computed.  net48 was computed.  net481 was computed. 
MonoAndroid monoandroid was computed. 
MonoMac monomac was computed. 
MonoTouch monotouch was computed. 
Tizen tizen40 was computed.  tizen60 was computed. 
Xamarin.iOS xamarinios was computed. 
Xamarin.Mac xamarinmac was computed. 
Xamarin.TVOS xamarintvos was computed. 
Xamarin.WatchOS xamarinwatchos was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

  • .NETStandard 2.0

    • No dependencies.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last Updated