WordPress.org

Codex

User:Cyberhobo/Editing robots.txt

This article is a ROUGH DRAFT. The author is still working on this document, so please do not edit this without the author's permission. The content within this article may not yet be verified or valid. This information is subject to change.

By default WordPress creates a "virtual" robots.txt file, which means that requests for robots.txt in your site root directory will receive a default response if there is no file with that name.

If you have created your own robots.txt file in the site root directory, it will be used instead of the virtual file. WordPress does not include a real robots.txt file to avoid overwriting yours if you have created it.

More Resources