Robots.txt Generator
Create a clean robots.txt file for your site.
Free · No sign-up · Runs in your browserWant to plan, schedule and track this properly?Viral Pulse Studio helps you plan content, schedule posts and report results in one place.
See StudioAbout this tool
Robots.txt tells well-behaved crawlers which parts of your site to skip. It is public and not a security measure, so never rely on it to hide private pages. Blocking a page does not remove it from search if it is linked elsewhere.
Questions
Where does it go?
At the root of your site, for example example.com/robots.txt.