Custom Robots TXT Generator

Default Policy (for User-agent: *)

Allow All Crawlers?

Specific Bot Rules

Select Bot (User-Agent) Googlebot Bingbot Baiduspider YandexBot DuckDuckBot GPTBot Rule Type Disallow Allow Path

Sitemaps

Sitemap URL

Live Preview: robots.txt