Can I see when SEO Moz has crawled my website?
-
I would like to know if it's possible to see (maybe in my Google Analytics) if SEO Moz has crawled my website.
I'm also curious if and where I can see when the robot of Google visited my website.
Thanks!
-
Thanks Megan and Martijn for your quick reply! They were both helpful
-
Hi Simone! This is Megan from SEOmoz. Your best option to see what bots have crawled your site and when is by checking your server logs. If our bot came through, you'll see our useragent 'rogerbot'.
Hope this helps!
-
Hi Simone,
You're as far as I know not able to see when Rogerbot crawled your site from within SEOMoz. You should be able to see when Googlebot visits your site from within Google Webmaster Tools. They provided crawl stats to see how many pages Googlebot visited.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Question about SEO and domains
Hello, Over time we have purchased many domain names that relate to our business. Let us say we sell chairs of type A, chairs of type B, Tables of Type C etc. We also have a main web site (main domain) which has been functioning for many years and is ranked well but not great. Since we have domain chairtypeA.com and chairtypeB.com I was thinking of putting them to good use as follows. STRATEGY A a) Create the domain as a parallel domain but is mainly informational - it talks about chair type A, its history, what to look for etc. It has the same IP address as main domain b) Have all the links on the page be directly linked to the MAIN site- so if you are on page for ChairtypeA and want to see it in a set you just click a link and it takes you to the main site. c) The look and feel of the ChairtypeA site is exactly the same as the main site - in fact except for the Heading, title and content the whole framework is from the main site. My hope is that if people are looking for chairtypeA, we would rank and attract customers. Plus it would use up some of the domain names we have purchased. THE OTHER ALTERNATIVE (Strategy B) is a) Create a domain for chairtypeA parallel to main domain (same IP address) b) redirect it to subfolder in main domain c) refer to the pages also as maindomain/chairtypeA (here is where it is no longer purely parallel) I have 3 objectives a) Use my purchased domain names b) Focus on certain products (liek ChairtypeA) c) Overall increase visibility and ranking Please give me any feedback which indicates whether Strategy A or Strategy B is more effective, or if any has negative consequences. Or you could suggest Strategy C - a completely new approach. Thanks Sam
Moz Pro | | samgold0 -
What does moz trust means?
Hi guys Moz toolbar show me my 'mT' of index page of my website is 7.07. Is it good?
Moz Pro | | vahidafshari450 -
Pages Crawled: 0 ?
I've been with SEO Moz for over a month and a half. Why would this weeks crawl have Pages Crawled: 0? I've made no changes since the crawl last week that had 10k pages crawled...
Moz Pro | | mr_w1 -
Crawl Diagnostic | Starter Crawl taken 14hrs.. so far
We started a starter crawl 14hrs ago and it's still going, can anyone help on why this is taking so long, when it says '2 hrs' on the interface.. Thanks, Rory
Moz Pro | | RoryMacDonald0 -
How can i find competitor title and descriptions in SEO moz PRO
Hi I can't seem to find competitor title and descriptions in SEO moz PRO. I am missing something?
Moz Pro | | smashseo0 -
Seomoz crawling filtered pages
Hi, I just checked an seo campaign we started last week, so I opened seomoz to see the crawl diagnostics. Lot's of duplicate content & duplicate titles showing up, but that's because Rogerbot is crawling all of the filtered pages as well. How do I exclude these pages from being crawled? /product/brand-x/3969?order=brand&sortorder=ASC
Moz Pro | | nvs.nim
/product/brand-x/3969?order=popular&sortorder=ASC
/product/brand-x/3969?order=popular&sortorder=DESC&page=10
/product/brand-x/3969?order=popular&sortorder=DESC&page=110 -
Only crawling one page
Hi there, A campaign was crawling fine, but at the last crawl, for some reason, SEOmoz can only crawl one page... any ideas? If I run a custom crawl I still access all of the site's pages.
Moz Pro | | harryholmes0070 -
Can anyone edit their comments?
I've been unable to edit my comments here for about a week 😕 Just me or is it like this for everyone? Tried FF 4, Chrome, IE 9, Safari and iPhone Safari. Just get the loading icon. If it's just me I'll submit a bug report.
Moz Pro | | StalkerB0