Skip To Content

Packages
Upload
Statistics
Documentation
Downloads
Blog

Sign in

Advanced search filters

Frameworks Filters packages based on the target frameworks they are compatible with. Learn more

Include compatible frameworks

Framework Filter Mode

ALL ANY

.NET

net9.0
net8.0
net7.0
net6.0
net5.0

.NET Core

netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0

.NET Standard

netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0

.NET Framework

net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20

Package type

All types

Dependency

.NET tool

Template

Options

Include prerelease

3 packages returned for Tags:"robotstxt"

Sort by

Toimik.RobotsProtocol
by: nurhafiz
- .NET 8.0
- 5,504 total downloads
- last updated 5/2/2024
- Latest version: 0.5.0
- robots.txt robots-txt robotstxt robots-exclusion-standard robots-exclusion-protocol robots-meta-tag x-robots-tag robots
Parsers for Robots Exclusion Standard (aka robots.txt), Robots Meta Tag, and X-Robots-Tag. Visit Project Site for documentation.
Casko.AspNetCore.RobotsTxt
by: Casko
- .NET 8.0
- 223 total downloads
- last updated 9/2/2024
- Latest version: 1.0.3
- robotstxt robots txt aspnetcore
A package for creating robots.txt files in ASP.NET Core applications.
RobotsTxtParser
by: desmati
- .NET 9.0
- 546 total downloads
- last updated 6/2/2025
- Latest version: 2025.9.4
- robots.txt RobotsTxtSharp RobotsTxt Robot Txt Robots parser SEO crawler
A .NET Core 9 library for parsing robots.txt files, supporting Allow/Disallow, Crawl‐delay, and Sitemap directives.

Contact

Got questions about NuGet or the NuGet Gallery?

Status

Find out the service status of NuGet.org and its related services.

FAQ

Read the Frequently Asked Questions about NuGet and see if your question made the list.

© Microsoft 2025 - About - Terms of Use - Privacy Statement - Trademarks

; ;