A robots.txt parser written in c#. This is an unofficial fork of NRobots.txt on codeplex with extended functionality. For full documentation see https://nrobots.codeplex.com/.
See the version list below for details.
Install-Package NRobotsPatched -Version 1.0.0
dotnet add package NRobotsPatched --version 1.0.0
<PackageReference Include="NRobotsPatched" Version="1.0.0" />
paket add NRobotsPatched --version 1.0.0
This package has no dependencies.
NuGet packages (1)
Showing the top 1 NuGet packages that depend on NRobotsPatched:
Nuget Package for Ingeniux InSite Search
GitHub repositories (1)
Showing the top 1 popular GitHub repositories that depend on NRobotsPatched:
Cross Platform C# web crawler framework built for speed and flexibility. Please star this project! +1.