2 packages returned for Tags:"robotstxt"

Package type

All types

Dependency

.NET tool

Template

Sort by

Relevance

Downloads

Recently updated

Options

Include prerelease

HalloJoe.RobotsTxt by: Hallojoe

A tool for accessing and querying the contents of a robots.txt file.

Toimik.RobotsProtocol The ID prefix of this package has been reserved for one of the owners of this package by NuGet.org.

by: nurhafiz

Parsers for Robots Exclusion Standard (aka robots.txt), Robots Meta Tag, and X-Robots-Tag. Visit Project Site for documentation.