Features
Productivity
Comparison
Pricing
FAQ
Roadmap
Get Started
Robots.txt Generator
Create a custom robots.txt file to guide search engine crawlers on your website.
Crawl Rules
User-agent
Disallowed Paths (one per line)
Allowed Paths (one per line)
/
Add Another User-agent
Sitemap URL
Preview
Copy
Download
User-agent: * Allow: /