Free SEO Tool
Robots.txt Generator
Pick rules and generate a ready-to-paste robots.txt file for your site.
Configure rules and click Generate robots.txt to create the file.
Robots.txt tips
Use staging: Disallow all on staging environments.
Sitemap: Include sitemap to help crawlers find pages faster.
User-agents: Add specific rules for crawlers when needed.
Check syntax: A single misplaced slash can block your entire site.
