Robots.txt Generator

Generate robots.txt files for your website. Control which pages search engines can crawl. Free robots.txt generator with templates.

Templates

User-agent

Disallowed Paths (one per line)

Allowed Paths (one per line)

Sitemap URL

Crawl-delay (seconds)

robots.txt

Ad Space

Free Robots.txt Generator

Create robots.txt files to control how search engines crawl your website. Use templates for WordPress, e-commerce or AI bot blocking. Add custom rules for specific crawlers.

What is robots.txt?

The robots.txt file tells search engine crawlers which pages they can and cannot access on your website. It's placed at the root of your domain (example.com/robots.txt).