If a webmaster wishes to restrict the information on their site to SWEBot, they can do so with the appropriate directives in a robots.txt file. SWEbot has user-agent “Mozilla/5.0 (compatible; SWEBot/1.0; +http://swebot.net)” and IP address “184.108.40.206″
Below are other user-agents and IP address currently used by SWEBot/1.0.
User-Agent = Mozilla/5.0 (compatible; SWEBot/1.0; +http://swebot-crawler.net)
IP address: 220.127.116.11
The following two tabs change content below.
About The Author:
Stephan Pringle is an Information Technology Support Specialist. He covers hardware
and provides tips for you to troubleshoot and repair issues on your own. In his spare time, he writes articles about the State of New York
on his Hackintosh
and that has helped him to become the top contributor of the New York City section of Yahoo! Answers.