Robots.txt Generator

Create a valid robots.txt file by configuring the rules below.

Default Policy (for all robots)

Crawl Delay

Sitemap URL

Checked bots will be fully blocked (Disallow: /).

Paths to block for all crawlers (applies when policy is not Disallow All).

Generated robots.txt

robots.txt

Configure the options to generate your robots.txt…

Preview updates automatically as you edit.