2 packages returned for Tags:"robotstxt"

Package type

All types

Dependency

.NET tool

Template

Sort by

Relevance

Downloads

Recently updated

Options

Include prerelease

HalloJoe.RobotsTxt by: Hallojoe
- 1,615 total downloads
- last updated 4/3/2018
- Latest version: 0.1.0
- robots.txt robotstxt
A tool for accessing and querying the contents of a robots.txt file.
Toimik.RobotsProtocol by: nurhafiz
- 2,969 total downloads
- last updated 12/22/2022
- Latest version: 0.4.0
- robots.txt robots-txt robotstxt robots-exclusion-standard robots-exclusion-protocol robots-meta-tag x-robots-tag robots
Parsers for Robots Exclusion Standard (aka robots.txt), Robots Meta Tag, and X-Robots-Tag. Visit Project Site for documentation.