Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
16 packages returned for Tags:"webcrawler"
Sort by
Relevance
Downloads
Recently updated
Earl.
Crawler.
Abstractions
by:
cryptoc1
.NET 6.0
6,896 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for an Earl (url) Crawler. Commonly used Types: Earl.Crawler.Abstractions.IEarlCrawler
Earl.
Crawler.
Middleware.
Abstractions
by:
cryptoc1
.NET 6.0
6,006 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for Earl Crawler's Middleware pattern. Commonly used Types: Earl.Crawler.Middleware.Abstractions.ICrawlerMiddleware...
More information
Earl.
Crawler.
Events
by:
cryptoc1
.NET 6.0
7,031 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's Events pattern.
Earl.
Crawler
by:
cryptoc1
.NET 6.0
5,917 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl is a suite of APIs for developing url crawlers & web scrapers driven by a middleware pattern similar to, and strongly influenced by, ASP.NET Core.
Earl.
Crawler.
Middleware.
Http
by:
cryptoc1
.NET 6.0
7,267 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for executing an HTTP request when crawling a Url. Commonly used Types: Earl.Crawler.Middleware.Http.Abstractions.IHttpRepsonseFeature
Earl.
Crawler.
Persistence
by:
cryptoc1
.NET 6.0
6,112 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's "Persistence" pattern.
Earl.
Crawler.
Middleware
by:
cryptoc1
.NET 6.0
6,047 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's Middleware pattern.
Earl.
Crawler.
Persistence.
Json
by:
cryptoc1
.NET 6.0
6,035 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
An implementation of Earl's "Persistence" pattern for persiting results to JSON files.
Earl.
Crawler.
Middleware.
UrlScraping
by:
cryptoc1
.NET 6.0
6,092 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for scarping and enqueuing urls via the Earl.Crawler.Middleware.Html.Abstractions.IHtmlDocumentFeature when crawling a url.
Earl.
Crawler.
Persistence.
Abstractions
by:
cryptoc1
.NET 6.0
5,876 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for Earl Crawler's "Persistence" pattern. Commonly used Types: Earl.Crawler.Persistence.Abstractions.ICrawlerPersistence
Earl.
Crawler.
Middleware.
Html
by:
cryptoc1
.NET 6.0
6,089 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for parsing an AngleSharp IHtmlDocument of the current HTTP request when crawling a url. Commonly used Types:...
More information
DotNetExpose
by:
joao2391
.NET 6.0
2,604 total downloads
last updated
4/20/2022
Latest version:
1.0.5
Scrap
WebScrap
Crawler
WebCrawler
A package that helps you to scrap web pages. It shows you a lot of information about the page.
prmToolkit.
Selenium
by:
paulorogerio
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
5,303 total downloads
last updated
2/27/2019
Latest version:
1.0.3
paulorogerio
selenium
webcrawler
webscraping
web
crawler
web
scraping
Facilita a intereção com Selenium através de comandos mais simples. Além de facilitar a realização de testes unitários, também é possível realizar Web Crawler ou Web Scraping
DotNetRankingBacen
by:
joao2391
.NET 6.0
1,118 total downloads
last updated
4/20/2022
Latest version:
1.1.1
Scrap
WebScrap
Crawler
WebCrawler
bacen
This lib helps you to get all informations from claim's list of BACEN.
CrawlerWave.
Core
by:
afborgesdev
.NET 5.0
.NET Core 2.2
519 total downloads
last updated
8/13/2019
Latest version:
0.0.0.3
WebCrawler
Selenium
Crawler
Headless
A fluent wrapper for Selenium and many usefull tools to web crawlers
DotNetAgenciasCorreios
by:
joao2391
.NET 6.0
758 total downloads
last updated
4/20/2022
Latest version:
1.0.1
Scrap
WebScrap
Crawler
WebCrawler
correios
This lib helps you to get brazilian's mail agency.