Free Online Robots.txt File Generator

Easily create a clean, effective robots.txt file to guide search engine crawlers on your website.

1. Global Crawl-Delay and Indexing

Default Robot Access for All Bots (*): Allow all crawling Disallow all crawling

Crawl-Delay (Seconds, 0 for none/default):

2. Sitemap Location

Full Sitemap URL (e.g., https://yoursite.com/sitemap.xml):

3. Disallowed Paths (One path per line)

Generated robots.txt Content: