Thanks! I was just wondering how it would be here in SEOMoz, Matt already helped me!
Posts made by MattDG
-
RE: Is there a easy way to see what pages are crawled?
-
RE: Can I prevent some pages from being crawled from SEOMoz spider and still not affect Google Spider?
Hey Martijn,
Thanks!
What about if I want to avoid rogerbot from crawling a range of pages from let's say /000001/; /000002/... /200000/ ?
Thanks!
-
Is there a easy way to see what pages are crawled?
Hello!
Like the questions says... Is there a easy way to see what pages are crawled? I don't mean the ones that have issues, but just the ones that have been crawled?
Regards,
-
RE: Can I prevent some pages from being crawled from SEOMoz spider and still not affect Google Spider?
Hey Martijn,
Thanks!
What about if I want to avoid rogerbot from crawling a range of pages from let's say /000001/; /000002/... /200000/ ?
Thanks!
-
Can I prevent some pages from being crawled from SEOMoz spider and still not affect Google Spider?
Well, basically that's the question Can I prevent some pages from being crawled from SEOMoz spider and still not affect Google Spider?
This is, I have more than 10.000 pages on the website, and I am not interested in having reports for many of them, but I still wanna get SEO visits on them, so I want Google to crawl it easily...
Thanks!