See the version list below for details.
dotnet add package RobotsTxtCore --version 1.0.1
NuGet\Install-Package RobotsTxtCore -Version 1.0.1
<PackageReference Include="RobotsTxtCore" Version="1.0.1" />
paket add RobotsTxtCore --version 1.0.1
#r "nuget: RobotsTxtCore, 1.0.1"
// Install RobotsTxtCore as a Cake Addin #addin nuget:?package=RobotsTxtCore&version=1.0.1 // Install RobotsTxtCore as a Cake Tool #tool nuget:?package=RobotsTxtCore&version=1.0.1
A Robots.txt middleware for ASP.NET Core. Why is this needed you ask? Because if you need to add dynamic values (such as a configured url from your CMS) you'll need some sort of code to handle that, and this makes it easy.
To specify multiple rules with the fluent interface makes it really easy.
app.UseRobotsTxt(builder => builder .AddSection(section => section .AddComment("Allow Googlebot") .AddUserAgent("Googlebot") .Allow("/") ) .AddSection(section => section .AddComment("Disallow the rest") .AddUserAgent("*") .AddCrawlDelay(TimeSpan.FromSeconds(10)) .Disallow("/") ) .AddSitemap("https://example.com/sitemap.xml") );
# Allow Googlebot User-agent: Googlebot Allow: / # Disallow the rest User-agent: * Disallow: / Crawl-delay: 10 Sitemap: https://example.com/sitemap.xml
Or if you just want to deny everyone.
app.UseRobotsTxt(builder => builder .DenyAll() );
User-agent: * Disallow: /
|Product||Versions Compatible and additional computed target framework versions.|
|.NET||net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed.|
|.NET Core||netcoreapp1.0 was computed. netcoreapp1.1 was computed. netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed.|
|.NET Standard||netstandard1.3 is compatible. netstandard1.4 was computed. netstandard1.5 was computed. netstandard1.6 was computed. netstandard2.0 is compatible. netstandard2.1 was computed.|
|.NET Framework||net46 was computed. net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed.|
|MonoAndroid||monoandroid was computed.|
|MonoMac||monomac was computed.|
|MonoTouch||monotouch was computed.|
|Tizen||tizen30 was computed. tizen40 was computed. tizen60 was computed.|
|Universal Windows Platform||uap was computed. uap10.0 was computed.|
|Xamarin.iOS||xamarinios was computed.|
|Xamarin.Mac||xamarinmac was computed.|
|Xamarin.TVOS||xamarintvos was computed.|
|Xamarin.WatchOS||xamarinwatchos was computed.|
NuGet packages (2)
Showing the top 2 NuGet packages that depend on RobotsTxtCore:
GitHub repositories (1)
Showing the top 1 popular GitHub repositories that depend on RobotsTxtCore:
☀☀支持Markdown导入的博客。后端基于最新的.Net6和Asp.Net Core框架，遵循RESTFul接口规范，前端基于Vue+ElementUI开发，可作为 .Net Core 入门项目学习~