Robots.txt for WordPress

Stephan Pringle Wednesday, April 10, 2013

Here is a sample of a the Robots.txt for WordPress that you may see on numerous sites..

# 1. A robot may not injure a web server or, through inaction, allow a web
# server to come to harm.
# 2. A robot must obey orders given it by web servers except where such
# orders would conflict with the First Law.
# 3. A robot must protect its own existence as long as such protection does
# not conflict with the First or Second Law.
#
User-agent: *
Disallow:
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /comments

Please keep in mind that identifying the location of the actual /wp-admin page will make it a candidate during the Global WordPress Attack.

The following two tabs change content below.
facebook-profile-picture
My Twitter profileMy Facebook profileMy LinkedIn profileMy Instagram profileMy Pinterest profileMy YouTube channel

Stephan Pringle

Technology Support Specialist at Sipylus
About The Author: Stephan Pringle is an Information Technology Support Specialist. He covers hardware and software and provides tips for you to troubleshoot and repair issues on your own. In his spare time, he writes articles about the State of New York on his Hackintosh and HackBook and that has helped him to become the top contributor of the New York City section of Yahoo! Answers.
facebook-profile-picture
My Twitter profileMy Facebook profileMy LinkedIn profileMy Instagram profileMy Pinterest profileMy YouTube channel

Latest posts by Stephan Pringle (see all)

Related posts:

  1. User-agent: Scrapy
  2. Install a WordPress Plugin
  3. WordPress
  4. Missing Tags & Categories in WordPress
  5. AntiCrawler.org
  6. Technical Support Specialist
  7. Technical Expert Help
  8. WordPress 3.9 Beta 3
  9. WordPress 3.9 Beta 2
  10. WordPress 4.0 Beta 2
  11. Skeleton Directory
  12. Vulnerable Themes
  13. WordPress Theme is Breaking SSL
  14. AdsPart.com
  15. WordPress Support
  16. dl-skin.php
  17. Global WordPress Attack
  18. New WordPress Site
  19. Missing Re-install Now Button
  20. wp-inorms.php
facebook-profile-picture

Stephan Pringle

About The Author: Stephan Pringle is an Information Technology Support Specialist. He covers hardware and software and provides tips for you to troubleshoot and repair issues on your own. In his spare time, he writes articles about the State of New York on his Hackintosh and HackBook and that has helped him to become the top contributor of the New York City section of Yahoo! Answers.

Related Posts