38 packages returned for Tags:"robot"

Abot Web Crawler
  • 91,842 total downloads
  • last updated 12/13/2018
  • Latest version: 1.6.0.13
  • crawler robot spider
Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own implementations of core interfaces to... More information
AbotX Web Crawler
A powerful C# web crawler that makes advanced crawling features easy to use. AbotX builds upon the open source Abot C# Web Crawler by providing a powerful set of wrappers and extensions.
  • 4,082 total downloads
  • last updated 11/21/2016
  • Latest version: 0.1.13-beta
  • crawler robot spider
.NET Core port of sjdirect/abot. Abot is an open source C# web crawler built for speed and flexibility. It takes care of the low level plumbing (multithreading, http requests, scheduling, link parsing, etc..). You just register for events to process the page data. You can also plugin your own... More information