Skip To Content
Toggle navigation
Packages
Upload
Statistics
Documentation
Downloads
Blog
Sign in
Advanced search filters
Frameworks
Include compatible frameworks
Framework Filter Mode
ALL
ANY
.NET
net8.0
net7.0
net6.0
net5.0
.NET Core
netcoreapp3.1
netcoreapp3.0
netcoreapp2.2
netcoreapp2.1
netcoreapp2.0
netcoreapp1.1
netcoreapp1.0
.NET Standard
netstandard2.1
netstandard2.0
netstandard1.6
netstandard1.5
netstandard1.4
netstandard1.3
netstandard1.2
netstandard1.1
netstandard1.0
.NET Framework
net481
net48
net472
net471
net47
net462
net461
net46
net452
net451
net45
net40
net35
net30
net20
Package type
All types
Dependency
.NET tool
Template
Options
Include prerelease
134 packages returned for Tags:"crawler"
Sort by
Relevance
Downloads
Recently updated
WebCrawler.
Core
by:
BestTime
.NET Framework 4.5.2
1,315 total downloads
last updated
12/10/2017
Latest version:
1.0.0
crawler
spider
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
CrawlerLib.
Engine.
TestHelper
by:
Crawler-Lib
.NET Framework
16,539 total downloads
last updated
3/7/2015
Latest version:
2.3.5544.21265
crawler-lib
test
helper
nunit
mstest
unit-test
crawler
spider
bot
scraper
More tags
The Crawler-Lib Engine Test Helper simplifies the test of tasks. It can be used to develop unit tests and integration tests for tasks.
Lztkdr.
SeleniumSpider
by:
lztkdr
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
2,025 total downloads
last updated
2/3/2022
Latest version:
1.2.0
Selenium
Spider
SeleniumSpider
Crawler
一个基于Selenium/Chrome浏览器池的爬虫类库。
DotnetSpiderLite.
Scheduler.
StackExchange.
Redis
by:
jxnkwlp
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,352 total downloads
last updated
5/31/2019
Latest version:
0.2.0
DotnetSpider
crawler
A .NET Standard web crawling library similar to WebMagic. It is a lightweight, modular, efficient and fast high-level web crawling. scraping framework for .NET
BCJobs.
HtmlAgilityPack
by:
Logan
.NET Framework 2.0
2,764 total downloads
last updated
1/31/2017
Latest version:
1.4.11
HTML
parse
crawler
spider
linq
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows...
More information
DataExtractingSDK
by:
DevRain
.NET Framework 4.0
4,123 total downloads
last updated
3/30/2012
Latest version:
1.0.1
data
extracting
html
processing
crawler
mining
Library allows you to extract different data from text or web sources, analyze text content, extract different information and write your own data mining & extracting applications and services.
Mechanize.
NET
by:
WilliamABradley
.NET 5.0
.NET Core 1.0
.NET Standard 1.4
.NET Framework 4.6.1
6,187 total downloads
last updated
12/8/2017
Latest version:
1.0.2
dotnet
dotnet-standard
analytics
spider
scaper
crawler
robots
html
htmlagilitypack
csharp
Stateful programmatic web browsing, based on Python-Mechanize, which is based on Andy Lester’s Perl module WWW::Mechanize.
DotnetSpider.
ExcelExpression
by:
zlzforever
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,681 total downloads
last updated
7/15/2019
Latest version:
4.0.6
DotnetSpider
crawler
dotnet
core
DotnetSpider, a .NET Standard web crawling library. It is lightweight, efficient and fast high-level web crawling & scraping framework
WebCrawler.
Pipelines
by:
BestTime
.NET Framework 4.5.2
1,035 total downloads
last updated
12/10/2017
Latest version:
1.0.0
crawler
spider
这是一个轻量级、快速、多线程、多管道、灵活配置的网络爬虫。
FakeAgent.
Net
by:
BenDerPan
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
1,493 total downloads
last updated
6/20/2020
Latest version:
1.0.2
Fake
Agent
Crawler
A fake agent random generater for cralwers.
GorticLib
by:
rwspatin
.NET 5.0
.NET Core 3.1
1,449 total downloads
last updated
5/21/2020
Latest version:
2.0.1
Crawler
Lib
TheCodefenders
GorticLib
A ASP.NET Core Lib to create automatic searchs more easy
HtmlDexterityPack
by:
stil
.NET 5.0
.NET Core 1.0
.NET Standard 1.6
.NET Framework 4.0
3,014 total downloads
last updated
4/22/2017
Latest version:
1.5.1
HtmlAgilityPack
HTML
parse
crawler
spider
linq
This is an agile HTML parser that builds a read/write DOM and supports plain XPATH or XSLT (you actually don't HAVE to understand XPATH nor XSLT to use it, don't worry...). It is a .NET code library that allows...
More information
CrawlerLib.
Engine
by:
Crawler-Lib
.NET Framework
32,852 total downloads
last updated
3/7/2015
Latest version:
2.3.5544.21265
crawler-lib
task
processor
workflow
action
async
await
crawler
spider
bot
More tags
The Crawler-Lib Engine is a general purpose workflow enabled task processor. It has evolved from a web crawler over data mining and information retrieval. It is throughput optimized and can perform thousands of...
More information
prmToolkit.
Selenium
by:
paulorogerio
.NET 5.0
.NET Core 2.0
.NET Standard 2.0
.NET Framework 4.6.1
5,303 total downloads
last updated
2/27/2019
Latest version:
1.0.3
paulorogerio
selenium
webcrawler
webscraping
web
crawler
web
scraping
Facilita a intereção com Selenium através de comandos mais simples. Além de facilitar a realização de testes unitários, também é possível realizar Web Crawler ou Web Scraping
TeamFortressOutpostApi
by:
igeligel
.NET 5.0
.NET Core 1.0
.NET Standard 1.3
.NET Framework 4.6
2,577 total downloads
last updated
4/19/2017
Latest version:
0.1.1
teamfortress2
steam
steambot
steam-api
crawler
bot
bot-framework
An API wrapper for the TF2 Outpost platform. A platform to find great deals for your Team Fortress 2, Counter-Strike: Global Offensive and Dota 2 items with zero hassle.
Exoscan
by:
AlexPavlov
Deprecated
.NET 6.0
1,075 total downloads
last updated
11/29/2022
Latest version:
4.0.2
scraper
crawler
parser
Declarative high performance web scraper in C#. Easily crawl any web site and parse the data, save structed result to a file, DB, etc.
ScrapeAAS.
InMemory
by:
ProphetLamb
.NET 6.0
563 total downloads
last updated
12/31/2023
Latest version:
1.0.3
scraper
crawler
Basic in-memory implementations of cookie storage and proxy providers for the ScrapeAAS library.
Juro
by:
Jerro
.NET 6.0
9,713 total downloads
last updated
3/6/2024
Latest version:
1.3.10
anime
video
manga
movie
parser
scraping
crawler
gogo
zoro
kaido
More tags
Client for source providers.
DotNetRankingBacen
by:
joao2391
.NET 6.0
1,118 total downloads
last updated
4/20/2022
Latest version:
1.1.1
Scrap
WebScrap
Crawler
WebCrawler
bacen
This lib helps you to get all informations from claim's list of BACEN.
XmlCrawler
by:
Megalypse
.NET 5.0
909 total downloads
last updated
7/30/2021
Latest version:
1.1.0
xml
crawler
xml-crawler
A package to make your life even more happy and simple when messing with XML files.
Previous
Next