👋 What do you think about NuGet.org? We're looking for feedback from developers like you.
Take the survey.
Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
16 packages returned for Tags:"WebCrawler"
Sort by
Relevance
Downloads
Recently updated
Earl.
Crawler.
Abstractions
by:
cryptoc1
6,414 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for an Earl (url) Crawler. Commonly used Types: Earl.Crawler.Abstractions.IEarlCrawler
Earl.
Crawler
by:
cryptoc1
5,447 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl is a suite of APIs for developing url crawlers & web scrapers driven by a middleware pattern similar to, and strongly influenced by, ASP.NET Core.
Earl.
Crawler.
Middleware.
Abstractions
by:
cryptoc1
5,522 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for Earl Crawler's Middleware pattern. Commonly used Types: Earl.Crawler.Middleware.Abstractions.ICrawlerMiddleware...
More information
Earl.
Crawler.
Middleware.
Http
by:
cryptoc1
6,723 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for executing an HTTP request when crawling a Url. Commonly used Types: Earl.Crawler.Middleware.Http.Abstractions.IHttpRepsonseFeature
Earl.
Crawler.
Events
by:
cryptoc1
6,547 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's Events pattern.
Earl.
Crawler.
Middleware
by:
cryptoc1
5,567 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's Middleware pattern.
Earl.
Crawler.
Persistence
by:
cryptoc1
5,633 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's "Persistence" pattern.
Earl.
Crawler.
Persistence.
Json
by:
cryptoc1
5,547 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
An implementation of Earl's "Persistence" pattern for persiting results to JSON files.
Earl.
Crawler.
Middleware.
Html
by:
cryptoc1
5,602 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for parsing an AngleSharp IHtmlDocument of the current HTTP request when crawling a url. Commonly used Types:...
More information
Earl.
Crawler.
Middleware.
UrlScraping
by:
cryptoc1
5,605 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for scarping and enqueuing urls via the Earl.Crawler.Middleware.Html.Abstractions.IHtmlDocumentFeature when crawling a url.
Earl.
Crawler.
Persistence.
Abstractions
by:
cryptoc1
5,395 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for Earl Crawler's "Persistence" pattern. Commonly used Types: Earl.Crawler.Persistence.Abstractions.ICrawlerPersistence
DotNetExpose
by:
joao2391
2,527 total downloads
last updated
4/20/2022
Latest version:
1.0.5
Scrap
WebScrap
Crawler
WebCrawler
A package that helps you to scrap web pages. It shows you a lot of information about the page.
prmToolkit.
Selenium
by:
paulorogerio
5,072 total downloads
last updated
2/27/2019
Latest version:
1.0.3
paulorogerio
selenium
webcrawler
webscraping
web
crawler
web
scraping
Facilita a intereção com Selenium através de comandos mais simples. Além de facilitar a realização de testes unitários, também é possível realizar Web Crawler ou Web Scraping
DotNetRankingBacen
by:
joao2391
1,027 total downloads
last updated
4/20/2022
Latest version:
1.1.1
Scrap
WebScrap
Crawler
WebCrawler
bacen
This lib helps you to get all informations from claim's list of BACEN.
CrawlerWave.
Core
by:
afborgesdev
485 total downloads
last updated
8/13/2019
Latest version:
0.0.0.3
WebCrawler
Selenium
Crawler
Headless
A fluent wrapper for Selenium and many usefull tools to web crawlers
DotNetAgenciasCorreios
by:
joao2391
700 total downloads
last updated
4/20/2022
Latest version:
1.0.1
Scrap
WebScrap
Crawler
WebCrawler
correios
This lib helps you to get brazilian's mail agency.