Robots.txt Generator
Generates a robots.txt file from a list of disallowed paths, a user-agent, and an optional sitemap URL.
How it works
Enter disallowed paths (one per line, optional), fill in the fields, and click Generate.
Generates a robots.txt file from a list of disallowed paths, a user-agent, and an optional sitemap URL.
Enter disallowed paths (one per line, optional), fill in the fields, and click Generate.