Iron Web Scraper is an elegant web scraping library for C#.
It allows developers to simulate and automate human browsing behavior in order to extract content, files and image content from web applications as native .Net objects. Developers have the power to write and debug their own synchronous code.
Iron Web Scraper will manage politeness and multithreading in the background, leaving your application easy to understand and maintain.
Iron Web Scraper can be used to migrate content from existing websites as well as build search indexes and monitor website structure & content changes.
Functionality of Iron WebScraper:
» Fast multi threading allows hundreds of simultaneous requests.
» Politely avoid over staring remote servers using IP and domain level trolling and optionally respecting robots.txt
» Manage multiple identities, DNS, proxies, user agents, request methods, custom headers, cookies and logins.
» Data exported from websites becomes native C# objects which can be stored or used immediately.
» Exceptions managed in all but the developers own code. Errors and captchas auto retried on failure
» Save, pause, resume, autosave scrape jobs.
» Built in web cache allows for action replay, crash recovery, and querying existing web scrape data.
» Change scrape logic on the fly and then action-replay your job without any internet traffic.
Requires .NET 4.5.2 - Licensing & Support available for commercial deployments.
For code examples, documentation & more visit http://ironsoftware.com/cshapr/webscraper
For support please email us at firstname.lastname@example.org
See the version list below for details.
Install-Package IronWebScraper -Version 4.0.4
dotnet add package IronWebScraper --version 4.0.4
<PackageReference Include="IronWebScraper" Version="4.0.4" />
paket add IronWebScraper --version 4.0.4
First public release of Iron WebScraper on Nuget.
Requires .Net 4.5.2 or newer
This package has no dependencies.
This package is not used by any NuGet packages.
This package is not used by any popular GitHub repositories.