Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
134 packages returned for Tags:"crawler"
Sort by
Relevance
Downloads
Recently updated
WebReaper
by:
AlexPavlov
.NET 7.0
5,151 total downloads
last updated
8/15/2023
Latest version:
3.5.1
scraper
crawler
parser
Declarative high performance web scraper in C#. Easily crawl any web site and parse the data, save structed result to a file, DB, etc.
Scraping
by:
otavioalfenas
.NET Framework 4.6.1
8,461 total downloads
last updated
10/14/2020
Latest version:
3.0.0.3
Scraping
C#
Crawler
Toolkit
Web
Robot
High productivity facilitator for scraping web pages
AppStoresScraper
by:
Dissimilis
.NET Framework 4.5
13,280 total downloads
last updated
6/9/2016
Latest version:
1.2.1-CI00002
GooglePlayStore
GoogleStore
PlayStore
ITunes
ITunesStore
WindowsStore
AppStore
Parser
Scraper
Crawler
AppStoresScraper is library for downloading app metadata from Steam, Google, Apple and Windows app stores
scSearchContrib.
Crawler
by:
sitecorian
.NET Framework 3.5
8,010 total downloads
last updated
5/7/2013
Latest version:
2.1.0
sitecore
search
lucene
advanced
database
crawler
The crawling/indexing component of the Sitecore Search Contrib project
SmogonTeamCrawler.
Core
by:
FullLifeGames
.NET 6.0
3,872 total downloads
last updated
1/23/2023
Latest version:
2.0.2
Smogon
Pokémon
Team
Crawler
Goes through http://www.smogon.com/forums/ and saves all teams it finds.
DotnetSpiderLite.
ProxyPools
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
2,285 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
PlurCrawler
by:
Plurdis
.NET Framework 4.6.1
3,115 total downloads
last updated
3/16/2018
Latest version:
1.0.2
WebCrawling
Crawler
Plurdis
Crawler For Big Data Anaysising
DotnetSpider.
Kafka
by:
zlzforever
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
3,302 total downloads
last updated
8/28/2019
Latest version:
4.0.8-beta2
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
AnimeDl
by:
Jerro
Deprecated
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
21,145 total downloads
last updated
3/14/2023
Latest version:
1.8.9
anime
animedl
scraper
animescraper
scraping
crawler
gogoanime
twistmoe
zoro
zoroto
More tags
AnimeDl scrapes animes from sites for streaming or downloading.
imbWEM.
Core
by:
goran.grubic
.NET Framework 4.0
3,934 total downloads
last updated
2/16/2018
Latest version:
0.1.2.12
WEM
Crawler
Semantic
Data
Mining
Web Exploration Model: crawlers, crawler reports, web analytic console, web loader, web crawler experiment setup...
Tenteikura
by:
bolthar
.NET Framework 4.0
1,960 total downloads
last updated
11/21/2012
Latest version:
1.0.0
Crawler
Web
A minimal multithreaded web crawler
DotNetExpose
by:
joao2391
.NET 6.0
2,602 total downloads
last updated
4/20/2022
Latest version:
1.0.5
Scrap
WebScrap
Crawler
WebCrawler
A package that helps you to scrap web pages. It shows you a lot of information about the page.
DotnetSpiderLite.
Scheduler.
Redis
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,724 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
HtmlAgilityPack_Helper
by:
parsa5
.NET Framework
5,429 total downloads
last updated
11/15/2017
Latest version:
2.0.0
HtmlAgilityPack
Html
Parse
Crawler
Spider
HAP
It helps you to use HAP in easier and meaningful way via Reflection. It works somehow like Entity-Framework. Go to wiki in github page for tutorial : https://github.com/parsalotfy/HtmlAgilityPack_Helper/wiki
SocialSense
by:
fakeezz
.NET Framework 4.0
5,274 total downloads
last updated
8/31/2013
Latest version:
1.2.0
social
crawler
twitter
facebook
google+
blog
Crawler for main social networks
totalrecall
by:
brandonc
.NET Framework
2,647 total downloads
last updated
6/8/2011
Latest version:
0.2.3
search
msbuild
crawler
lucene
Crawl and index your (static) asp.net website for searching using an MSBuild target. Simple search query interface. Uses Lucene.Net and NCrawler.
DotnetSpiderLite.
NLog
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,429 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
CoreCompat.
NScrape
by:
quamotion
.NET 5.0
.NET Core 1.0
.NET Standard 1.5
.NET Framework 4.5
8,879 total downloads
last updated
9/22/2017
Latest version:
0.4.0-r6
html
scrape
scraper
scraping
crawler
crawling
htmlagilitypack
htmlagility
agility
A web scraping framework for .Net
DotnetSpiderLite.
AngleSharp
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,435 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
WebCrawler.
Core
by:
BestTime
.NET Framework 4.5.2
1,314 total downloads
last updated
12/10/2017
Latest version:
1.0.0
crawler
spider
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
Previous
Next