CrawlerLib.Engine 2.1.5291.40524

Crawler-Lib Engine

The Crawler-Lib Engine is a general purpose workflow enabled task processor. It has evolved from a web crawler over data mining and information retrieval. It is throughput optimized and can perform thousands of tasks per second on standard hardware. Due to its workflow capabilities it allows to structure and parallelize even complex kind of work. Please visit the project page for the complete view of the Crawler-Lib Engine.

     A license for the Anonymous Edition is included in the package. A license for the more powerful free Community Edition can be generated on the project page.

There is a newer version of this package available.
See the version list below for details.
Install-Package CrawlerLib.Engine -Version 2.1.5291.40524
dotnet add package CrawlerLib.Engine --version 2.1.5291.40524
paket add CrawlerLib.Engine --version 2.1.5291.40524
The NuGet Team does not provide support for this client. Please contact its maintainers for support.

Release Notes

* Added additional constructors to several workflow elements. So you can construct and use them without specifying a complete configuration object for the element.
     * Added AwaitProcessingEnum awaitProcessing to several workflow element constructors, so you can specify that the continuation will be called on failure and check the Success property to decide what to do.

     Version 2.1.5288.13218:
     * The workflow elements are awaitable since this release.
     * New workflow elements for limits and operation cost calculation have been added.
     * A vast amount of small extensions and refactoring

     Version 2.00 -2.01 -2.02:
     * First public releases

Version History

Version Downloads Last updated
2.3.5544.21265 811 3/7/2015
2.3.5538.27074 230 3/1/2015
2.3.5535.18986 247 2/26/2015
2.3.5529.650 241 2/20/2015
2.3.5515.2909 274 2/6/2015
2.3.5514.24037 239 2/5/2015
2.3.5513.24819 246 2/4/2015
2.3.5507.444 247 1/29/2015
2.3.5503.33731 257 1/25/2015
2.3.5503.4086 260 1/25/2015
2.2.5490.21676 282 1/12/2015
2.2.5367.17954 315 9/11/2014
2.1.5296.19510 314 7/2/2014
2.1.5291.40524 277 6/27/2014
2.1.5288.13218 297 6/24/2014
2.0.2 677 9/6/2013
2.0.1 431 6/25/2013
2.0.0 369 6/22/2013
Show less