Unsolved

This post is more than 5 years old

131 Posts

5764

September 26th, 2007 15:00

robots.txt

There is a blog that I access every day. Suddenly, yesterday, it would come on briefly, then I would get an error message saying it could not find the site, and ended it with robots.txt.
 
I checked with the owner who said that he had many hits yesterday and no complaints except from me.  So what would cause that?
 
I did a search on my computer and didn't find robots.txt anywhere.  Also did a virus scan all was well.

This is the only site that I can't access.

Thanks for any help, Peggy

15 Posts

September 26th, 2007 15:00

Hello,
Robots.txt is a file that is placed on a webserver to prevent search engines like, yahoo and google from indexing their pages, it odes not reside on your machine and has no i'll effects, most likley the owner of the site has a confiuration error that is prevent the displaying of the proper material .. thus you recieving the robots.txt error
 
In a nutshell.. nothing to worry about
 
Later
No Events found!

Top