See the version list below for details.
dotnet add package RobotsTxtCore --version 1.0.0-beta-1
NuGet\Install-Package RobotsTxtCore -Version 1.0.0-beta-1
<PackageReference Include="RobotsTxtCore" Version="1.0.0-beta-1" />
paket add RobotsTxtCore --version 1.0.0-beta-1
#r "nuget: RobotsTxtCore, 1.0.0-beta-1"
// Install RobotsTxtCore as a Cake Addin #addin nuget:?package=RobotsTxtCore&version=1.0.0-beta-1&prerelease // Install RobotsTxtCore as a Cake Tool #tool nuget:?package=RobotsTxtCore&version=1.0.0-beta-1&prerelease
A Robots.txt middleware for ASP.NET Core.
To specify multiple rules with the fluent interface makes it really easy.
app.UseRobotsTxt(builder => builder .AddSection(section => section .AddComment("Allow Googlebot") .AddUserAgent("Googlebot") .Allow("/") ) .AddSection(section => section .AddComment("Disallow the rest") .AddUserAgent("*") .AddCrawlDelay(TimeSpan.FromSeconds(10)) .Disallow("/") ) .AddSitemap("https://example.com/sitemap.xml") );
# Allow Googlebot User-agent: Googlebot Allow: / # Disallow the rest User-agent: * Disallow: / Crawl-delay: 10 Sitemap: https://example.com/sitemap.xml
Or if you just want to deny everyone.
app.UseRobotsTxt(builder => builder .DenyAll() );
User-agent: * Disallow: /
|Product||Versions Compatible and additional computed target framework versions.|
|.NET||net5.0 was computed. net5.0-windows was computed. net6.0 was computed. net6.0-android was computed. net6.0-ios was computed. net6.0-maccatalyst was computed. net6.0-macos was computed. net6.0-tvos was computed. net6.0-windows was computed. net7.0 was computed. net7.0-android was computed. net7.0-ios was computed. net7.0-maccatalyst was computed. net7.0-macos was computed. net7.0-tvos was computed. net7.0-windows was computed. net8.0 was computed. net8.0-android was computed. net8.0-ios was computed. net8.0-maccatalyst was computed. net8.0-macos was computed. net8.0-tvos was computed. net8.0-windows was computed.|
|.NET Core||netcoreapp1.0 was computed. netcoreapp1.1 was computed. netcoreapp2.0 was computed. netcoreapp2.1 was computed. netcoreapp2.2 was computed. netcoreapp3.0 was computed. netcoreapp3.1 was computed.|
|.NET Standard||netstandard1.3 is compatible. netstandard1.4 was computed. netstandard1.5 was computed. netstandard1.6 was computed. netstandard2.0 is compatible. netstandard2.1 was computed.|
|.NET Framework||net46 was computed. net461 was computed. net462 was computed. net463 was computed. net47 was computed. net471 was computed. net472 was computed. net48 was computed. net481 was computed.|
|MonoAndroid||monoandroid was computed.|
|MonoMac||monomac was computed.|
|MonoTouch||monotouch was computed.|
|Tizen||tizen30 was computed. tizen40 was computed. tizen60 was computed.|
|Universal Windows Platform||uap was computed. uap10.0 was computed.|
|Xamarin.iOS||xamarinios was computed.|
|Xamarin.Mac||xamarinmac was computed.|
|Xamarin.TVOS||xamarintvos was computed.|
|Xamarin.WatchOS||xamarinwatchos was computed.|
NuGet packages (2)
Showing the top 2 NuGet packages that depend on RobotsTxtCore:
GitHub repositories (1)
Showing the top 1 popular GitHub repositories that depend on RobotsTxtCore:
☀☀支持Markdown导入的博客。后端基于最新的.Net6和Asp.Net Core框架，遵循RESTFul接口规范，前端基于Vue+ElementUI开发，可作为 .Net Core 入门项目学习~