Here is a sample of a the Robots.txt for WordPress that you may see on numerous sites..

# 1. A robot may not injure a web server or, through inaction, allow a web
# server to come to harm.
# 2. A robot must obey orders given it by web servers except where such
# orders would conflict with the First Law.
# 3. A robot must protect its own existence as long as such protection does
# not conflict with the First or Second Law.
#
User-agent: *
Disallow:
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /comments

Please keep in mind that identifying the location of the actual /wp-admin page will make it a candidate during the Global WordPress Attack.

The following two tabs change content below.

• Bio
• Latest Posts

Stephan Pringle

Chief Executive Officer at Sipylus

About The Author: Stephan Pringle is an Information Technology Specialist. He covers hardware and software and provides tips for you to troubleshoot and repair issues on your own. In his spare time, he writes articles about the State of New York on his Hackintosh and HackBook and that has helped him to become the top contributor of the New York City section of Yahoo! Answers.

Latest posts by Stephan Pringle (see all)

• Configuration.xml - Friday, March 12, 2021