• Background
    • Awards
    • Biography
    • Resume
  • Blog
    • Articles
    • Cookie Policy
    • Galleries
      • Photo Gallery
      • Video Gallery
    • Glossary
  • Contact
    • Contact
    • Social Networks
  • IT
    • Downloads
      • Windows
    • Equipment
    • Hardware
    • Software
    • Testimonial
    • Information Technology
  • Projects
    • Business Projects
    • HackBook Projects
    • Hackintosh Projects
    • Website Projects
    • More Projects
  • Service Rates
    • Business Rates
    • Residential Rates

Robots.txt for WordPress

Wednesday, April 10, 2013 Articles, Tips Comments Off on Robots.txt for WordPress

Here is a sample of a the Robots.txt for WordPress that you may see on numerous sites..

# 1. A robot may not injure a web server or, through inaction, allow a web
# server to come to harm.
# 2. A robot must obey orders given it by web servers except where such
# orders would conflict with the First Law.
# 3. A robot must protect its own existence as long as such protection does
# not conflict with the First or Second Law.
#
User-agent: *
Disallow:
Disallow: /wp-admin
Disallow: /wp-includes
Disallow: /wp-login.php
Disallow: /wp-content/plugins
Disallow: /wp-content/cache
Disallow: /wp-content/themes
Disallow: /trackback
Disallow: /comments

Please keep in mind that identifying the location of the actual /wp-admin page will make it a candidate during the Global WordPress Attack.

The following two tabs change content below.
  • Bio
  • Latest Posts
facebook-profile-picture
My Twitter profileMy Facebook profileMy LinkedIn profileMy Pinterest profileMy YouTube channel

Stephan Pringle

Chief Executive Officer at Sipylus
About The Author: Stephan Pringle is an Information Technology Specialist. He covers hardware and software and provides tips for you to troubleshoot and repair issues on your own. In his spare time, he writes articles about the State of New York on his Hackintosh and HackBook and that has helped him to become the top contributor of the New York City section of Yahoo! Answers.
facebook-profile-picture
My Twitter profileMy Facebook profileMy LinkedIn profileMy Pinterest profileMy YouTube channel

Latest posts by Stephan Pringle (see all)

  • Configuration.xml - Friday, March 12, 2021

Related posts:

  1. Vulnerable Themes
  2. dl-skin.php
  3. ErrorDocument 410
  4. Remove Powered By
  5. WordPress
  6. WordPress Theme Generator
  7. New WordPress Site
  8. Missing Tags & Categories in WordPress
  9. Automatically Apply WordPress Updates
  10. Recover a Hacked WordPress Site
  11. WordPress Theme is Breaking SSL
  12. Global WordPress Attack
  13. WordPress 3.7 Beta 1
  14. WordPress 3.7 Beta 2
  15. WordPress 3.8 Beta 1
  16. WordPress 3.8.1 Maintenance Release
  17. WordPress 3.9 Beta 3
  18. WordPress 3.9 Beta 2
  19. WordPress 4.0 Beta 2
  20. Install a WordPress Plugin

Comments are closed.




Copyright © 1990-2020 Stephan Pringle. All rights reserved.

Stephan Pringle

IT Technical Support Specialist

  • Keyword Search

  • Translator

  • Topic Sponsor

I am always working to improve your experience on my website. Part of this involves using cookies to collect anonymous data for statistics and personalization. Learn more