IronWebScraper 2024.5.8

The ID prefix of this package has been reserved for one of the owners of this package by NuGet.org. Prefix Reserved
dotnet add package IronWebScraper --version 2024.5.8
NuGet\Install-Package IronWebScraper -Version 2024.5.8
This command is intended to be used within the Package Manager Console in Visual Studio, as it uses the NuGet module's version of Install-Package.
<PackageReference Include="IronWebScraper" Version="2024.5.8" />
For projects that support PackageReference, copy this XML node into the project file to reference the package.
paket add IronWebScraper --version 2024.5.8
#r "nuget: IronWebScraper, 2024.5.8"
#r directive can be used in F# Interactive and Polyglot Notebooks. Copy this into the interactive tool or source code of the script to reference the package.
// Install IronWebScraper as a Cake Addin
#addin nuget:?package=IronWebScraper&version=2024.5.8

// Install IronWebScraper as a Cake Tool
#tool nuget:?package=IronWebScraper&version=2024.5.8

Nuget Installs Passed windows livechat

Iron WebScraper - The C# WebScraping Library

IronWebscraper NuGet Trial Banner Image

Get Started | Code Examples | Licensing | Free Trial

Iron WebScraper is a C# web scraping library, allowing developers to simulate & automate human browsing behavior to extract content, files & images from web applications as native .Net objects. Iron Web Scraper manages politeness & multithreading in the background, leaving a developer’s own application easy to understand & maintain.

Iron WebScraper can be used to migrate content from existing websites as well as build search indexes and monitor website structure & content changes.

Iron WebScraper allows developers to:

  • Read & extract structured content from web pages using html DOM, Javascript, Xpath, jQuery Style CSS Selectors.
  • Fast multi threading allows hundreds of simultaneous requests.
  • Politely avoid over stalling remote servers using IP/domain level throttling & optionally respecting robots.txt
  • Manage multiple identities, DNS, proxies, user agents, request methods, custom headers, cookies & logins.
  • Data exported from websites becomes native C# objects which can be stored or used immediately.
  • Exceptions managed in all but the developers own code. Errors and captchas auto retried on failure
  • Save, pause, resume, autosave scrape jobs.
  • Built in web cache allows for action replay, crash recovery, and querying existing web scrape data. Change scrape logic on the fly, then replay job without internet traffic.

Iron WebScraper has cross platform support compatibility with:

  • .NET 6 and .NET 5, .NET Core, Standard, and Framework
  • Windows, macOS, Linux, Docker, Azure, and AWS

IronWebScraper Cross Platform Compatibility Support Image

Additionally, our API reference and full licensing information can easily be found on our website.

Using Iron WebScraper

Installing the IronWebScraper NuGet package is quick and easy, please install the package like this:

PM> Install-Package IronWebScraper

Once installed, you can get started by adding using IronWebScraper to the top of your C# code. Here is an example to get started:

using IronWebScraper;

namespace YourApp
{
    public class Program
    {
        private static void Main(string[] args)
        {
            var ScrapeJob = new BlogScraper();
            ScrapeJob.Start();
        }
    }

    public class BlogScraper : WebScraper
    {
        public override void Init()
        {
            LoggingLevel = LogLevel.All;
            Request("https://www.zyte.com/blog/", Parse);
        }

        public override void Parse(Response response)
        {
            foreach (HtmlNode title_link in response.Css(".oxy-post-title"))
            {
                string strTitle = title_link.TextContentClean;
                Scrape(new ScrapedData() { { "Title", strTitle } });
            }

            if (response.CssExists("div.oxy-easy-posts-pages > a[href]"))
            {
                string next_page = response.Css("div.oxy-easy-posts-pages > a[href]")[0].Attributes["href"];
                Request(next_page, Parse);
            }
        }
    }
}

Licensing & Support available

For code examples, tutorials and documentation visit https://ironsoftware.com/csharp/webscraper/

For support please email us at developers@ironsoftware.com

You can email us at developers@ironsoftware.com for support directly from our code team. We offer licensing and extensive support for commercial deployment projects.

Product Compatible and additional computed target framework versions.
.NET net5.0 was computed.  net5.0-windows was computed.  net6.0 was computed.  net6.0-android was computed.  net6.0-ios was computed.  net6.0-maccatalyst was computed.  net6.0-macos was computed.  net6.0-tvos was computed.  net6.0-windows was computed.  net7.0 was computed.  net7.0-android was computed.  net7.0-ios was computed.  net7.0-maccatalyst was computed.  net7.0-macos was computed.  net7.0-tvos was computed.  net7.0-windows was computed.  net8.0 was computed.  net8.0-android was computed.  net8.0-browser was computed.  net8.0-ios was computed.  net8.0-maccatalyst was computed.  net8.0-macos was computed.  net8.0-tvos was computed.  net8.0-windows was computed. 
.NET Core netcoreapp2.0 was computed.  netcoreapp2.1 was computed.  netcoreapp2.2 was computed.  netcoreapp3.0 was computed.  netcoreapp3.1 was computed. 
.NET Standard netstandard2.0 is compatible.  netstandard2.1 is compatible. 
.NET Framework net461 was computed.  net462 was computed.  net463 was computed.  net47 was computed.  net471 was computed.  net472 was computed.  net48 was computed.  net481 was computed. 
MonoAndroid monoandroid was computed. 
MonoMac monomac was computed. 
MonoTouch monotouch was computed. 
Tizen tizen40 was computed.  tizen60 was computed. 
Xamarin.iOS xamarinios was computed. 
Xamarin.Mac xamarinmac was computed. 
Xamarin.TVOS xamarintvos was computed. 
Xamarin.WatchOS xamarinwatchos was computed. 
Compatible target framework(s)
Included target framework(s) (in package)
Learn more about Target Frameworks and .NET Standard.

NuGet packages

This package is not used by any NuGet packages.

GitHub repositories

This package is not used by any popular GitHub repositories.

Version Downloads Last updated
2024.5.8 149 4/29/2024
2024.4.4 205 4/4/2024
2024.3.6 263 3/8/2024
2024.2.2 523 1/29/2024
2024.1.3 685 12/29/2023
2023.12.4 880 11/27/2023
2023.11.9 825 10/27/2023
2023.10.8 789 10/6/2023
2023.10.7 757 9/29/2023
2023.9.7 1,003 8/31/2023
2023.8.1 4,424 7/31/2023
2023.7.3 1,136 7/3/2023
2023.6.1 1,191 5/29/2023
2023.5.1 1,086 5/1/2023
2023.4.13 3,613 3/29/2023
2023.2.2 1,395 2/27/2023
2023.1.22 3,246 1/19/2023
2021.11.0 28,325 10/29/2021
2021.9.0 1,794 8/24/2021
2021.6.5 1,454 6/7/2021
4.0.4.3 25,258 4/14/2017
4.0.4 2,170 3/30/2017

* Minor Bug Fixes
           * Updates IronSoftware.System.Drawing to version 2024.5.1