🤖 Robots.txt Generator
Generate a robots.txt file for your website to control crawlers.
Disallow Paths (one per line)
Allow Paths (one per line)
Generated robots.txt
📖 How to Use
- Add your sitemap URL.
- Specify paths to disallow or allow.
- Optionally block AI crawlers.
- Download and upload robots.txt to your website root.