I'm sure why it let you scroll and not me?
Posts made by MirandaP
-
RE: Search Engine blocked by robots.txt
-
Search Engine blocked by robots.txt
I am getting this error whe I try to crawl http://photosales.belfasttelegraph.co.uk/ but my robots.txt file does not block any bots?