Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
16 packages returned for Tags:"WebCrawler"
Sort by
Relevance
Downloads
Recently updated
Earl.
Crawler.
Abstractions
by:
cryptoc1
.NET 6.0
6,894 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for an Earl (url) Crawler. Commonly used Types: Earl.Crawler.Abstractions.IEarlCrawler
Earl.
Crawler.
Middleware.
Abstractions
by:
cryptoc1
.NET 6.0
6,004 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for Earl Crawler's Middleware pattern. Commonly used Types: Earl.Crawler.Middleware.Abstractions.ICrawlerMiddleware...
More information
Earl.
Crawler
by:
cryptoc1
.NET 6.0
5,915 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl is a suite of APIs for developing url crawlers & web scrapers driven by a middleware pattern similar to, and strongly influenced by, ASP.NET Core.
Earl.
Crawler.
Middleware.
Http
by:
cryptoc1
.NET 6.0
7,265 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for executing an HTTP request when crawling a Url. Commonly used Types: Earl.Crawler.Middleware.Http.Abstractions.IHttpRepsonseFeature
Earl.
Crawler.
Events
by:
cryptoc1
.NET 6.0
7,029 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's Events pattern.
Earl.
Crawler.
Persistence
by:
cryptoc1
.NET 6.0
6,110 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's "Persistence" pattern.
Earl.
Crawler.
Persistence.
Json
by:
cryptoc1
.NET 6.0
6,033 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
An implementation of Earl's "Persistence" pattern for persiting results to JSON files.
Earl.
Crawler.
Middleware
by:
cryptoc1
.NET 6.0
6,045 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Default implementation of Earl's Middleware pattern.
Earl.
Crawler.
Middleware.
Html
by:
cryptoc1
.NET 6.0
6,087 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for parsing an AngleSharp IHtmlDocument of the current HTTP request when crawling a url. Commonly used Types:...
More information
Earl.
Crawler.
Middleware.
UrlScraping
by:
cryptoc1
.NET 6.0
6,090 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Earl Middleware for scarping and enqueuing urls via the Earl.Crawler.Middleware.Html.Abstractions.IHtmlDocumentFeature when crawling a url.
Earl.
Crawler.
Persistence.
Abstractions
by:
cryptoc1
.NET 6.0
5,874 total downloads
last updated
3/30/2022
Latest version:
0.0.0-alpha.0.111
Earl
WebCrawler
UrlScraping
Abstractions for Earl Crawler's "Persistence" pattern. Commonly used Types: Earl.Crawler.Persistence.Abstractions.ICrawlerPersistence
DotNetExpose
by:
joao2391
.NET 6.0
2,602 total downloads
last updated
4/20/2022
Latest version:
1.0.5
Scrap
WebScrap
Crawler
WebCrawler
A package that helps you to scrap web pages. It shows you a lot of information about the page.
prmToolkit.
Selenium
by:
paulorogerio
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
5,297 total downloads
last updated
2/27/2019
Latest version:
1.0.3
paulorogerio
selenium
webcrawler
webscraping
web
crawler
web
scraping
Facilita a intereção com Selenium através de comandos mais simples. Além de facilitar a realização de testes unitários, também é possível realizar Web Crawler ou Web Scraping
CrawlerWave.
Core
by:
afborgesdev
.NET 5.0
.NET Core 2.2
517 total downloads
last updated
8/13/2019
Latest version:
0.0.0.3
WebCrawler
Selenium
Crawler
Headless
A fluent wrapper for Selenium and many usefull tools to web crawlers
DotNetRankingBacen
by:
joao2391
.NET 6.0
1,117 total downloads
last updated
4/20/2022
Latest version:
1.1.1
Scrap
WebScrap
Crawler
WebCrawler
bacen
This lib helps you to get all informations from claim's list of BACEN.
DotNetAgenciasCorreios
by:
joao2391
.NET 6.0
756 total downloads
last updated
4/20/2022
Latest version:
1.0.1
Scrap
WebScrap
Crawler
WebCrawler
correios
This lib helps you to get brazilian's mail agency.