Package type

All types

Dependency

.NET tool

Template

Options

Include prerelease

1 package returned for Tags:"robots-exclusion-protocol"

Sort by

Toimik.RobotsProtocol by: nurhafiz
- 3,016 total downloads
- last updated 12/22/2022
- Latest version: 0.4.0
- robots.txt robots-txt robotstxt robots-exclusion-standard robots-exclusion-protocol robots-meta-tag x-robots-tag robots
Parsers for Robots Exclusion Standard (aka robots.txt), Robots Meta Tag, and X-Robots-Tag. Visit Project Site for documentation.