robots.txt Generator
Add per-user-agent allow/block rules and your sitemap location to generate robots.txt instantly
도구를 불러오는 중…
🔒 Everything runs 100% in your browser. Your files and input are never uploaded to any server.
Create a robots.txt file—which tells search engine crawlers which paths to allow or block—in just a few clicks. Enter Allow/Disallow rules per user-agent group and your sitemap location to instantly generate and download a standard-format file.
How to use
- Start from an 'Allow all / Block all' preset, or enter your own rules.
- Set the user-agent and list Disallow/Allow paths one per line.
- Add more groups if needed and enter sitemap URLs one per line.
- Grab the result with 'Copy robots.txt' or 'Download file.'
FAQ
- Are the paths I enter sent to a server?
- No. Entering rules and generating robots.txt all happen only in your browser, and no path or URL is ever transmitted or stored on a server.
- Where should I upload the file?
- It must be uploaded to your site's root as a file named robots.txt—for example, https://example.com/robots.txt. Search engines won't recognize it if it sits in a subfolder.
- Does Disallow remove a page from search results entirely?
- No. Disallow only asks crawlers not to visit; it doesn't block indexing itself. To reliably remove a page from search results, use a noindex meta tag on it or protect access with authentication.