Can I see when SEO Moz has crawled my website?
-
I would like to know if it's possible to see (maybe in my Google Analytics) if SEO Moz has crawled my website.
I'm also curious if and where I can see when the robot of Google visited my website.
Thanks!
-
Thanks Megan and Martijn for your quick reply! They were both helpful
-
Hi Simone! This is Megan from SEOmoz. Your best option to see what bots have crawled your site and when is by checking your server logs. If our bot came through, you'll see our useragent 'rogerbot'.
Hope this helps!
-
Hi Simone,
You're as far as I know not able to see when Rogerbot crawled your site from within SEOMoz. You should be able to see when Googlebot visits your site from within Google Webmaster Tools. They provided crawl stats to see how many pages Googlebot visited.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My website was at the top of Google search for some years... suddenly I almost can't reach first page! Moz ranks my website better than the competitors... what might be going one? Could anybody help me out? Thanks!
Hello Guys! My website was at the top of Google search for some years... suddenly I almost can't reach first page! Moz ranks my website better than the competitors... what might be going one? Could anybody help me out? Moz rank us grade A... the competitors B or C .. I think we have better back links than they do... Would you need any kind of data or report to help me here? Thanks!
Moz Pro | | wesleyms0 -
Redirects, SEO and More
Website errors remittent of Chernobyl. First of all, I ask a lot of questions of the community and I don't do a lot of answering. For that, I am sorry! I own a small SEO company and the majority of my clients are upstarts just like myself. We try to do the best we can on a very limited budget.
Moz Pro | | underdogmike
With that said, the client website in question, http://bestdefensega.com has been a struggle to rank in the metro atlanta lawyer market.
Here's the story. My client is a new solo attorney that practices criminal law and personal injury law. We launched bestdensega.com to focus on criminal defense and my client has also paid AVVO for a website as well. We recently decided to make a monster website that would have 50+ pages and be representative of all that he practices.
I recently put a temporary redirect on bestdefensega.com and pointed it to the avvo website while I was rebuilding the website. I did this using a plugin.
This morning I decided that I wanted to remove the redirect, so I deactivated and deleted the plugin. The redirect is still in effect. I suspect that this may be a cacheing scenario.
How do I undo a redirect?
Also, I noticed that the AVVO site has all of a sudden shot up to the top of the search results and bestdefnesega.com has dropped past the 3rd page for our keywords. Have I lost all of bestdefensega.com's link juice? Also, bestdefensega.com has a spam score of 7. Why? There are no shady links and everything I do is on the up and up. Also Open Site Explorer says that bestdefensega.com doesn't have any inbound links.
Google WebMaster Tools says that the site has of 500 inbound links.. Frustrated, Thanks0 -
Is SeoMOZ Crawl Diagnostics wrong here?
We've been getting a ton of critical errors (about 80,000) in SeoMoz' Crawl Diagnostics saying we have duplicate content in our client's E-commerce site. Some of the errors are correct, but a lot of the pages are variations like: www.example.com/productlist?page=1 www.example.com/productlist?page=2 However, in our source code we have used rel="prev" and rel="next" so in my opinion we should be alright. Would love to hear from you if we have made a mistake or if it is an error in SeoMoz. Here's a full paste of the script:
Moz Pro | | Webdannmark0 -
SEOMOZ Crawl Test
Guys I really have an issue that i know have but cannot see if that makes sense. Basically 3 months ago i did a site wide 301 from economyleasinguk.co.uk to www.economy-car-leasing.co.uk Every thing looks good get all the correct header responses , all canonicals work perfectly , Google webmaster tools is updated fetch as google bot shows the old site is 301 I tried the seomoz crawl test today on the old domain and got this message Oh no! Looks like the page you were trying to access is temporarily down which at first thought ok because the site was not there it wont do it on an old 301 domain, however i tried it on a domain i know has just been 301'd and i got this message The URL http://www.site1.com/ redirects to http://site2.com/. Do you want to crawl http://site2.com/ instead?
Moz Pro | | kellymandingo
Would you like to:
Continue with www.site1.com
Continue with site2.com I really do not know what to do, its either the redirect script is missing something however its doing what it should or the server is a problem but again its doing what it should so why would SEOMOZ not be able to crawl the old URL like it example site above. Now the strange thing is Open Site Explorer does see the 301 and asks if i want to check the new URL instead Ps the redirect is done using PHP redirect which i am asking him to change to a htaccess as its now on a apache server and was wondering if this could be an issue, all pages go to correct pages as requested Thanks in Advance1 -
Can I combine SEOmoz Campaigns.
Basically I am in internal SEO. We subscribe to SEOmoz and we have 5 campaign spots. each with their own allocation of keywords. Ideally I only want to track our site and not 4 other's. I've currently setup the campaign a couple of times with different keywords, but it would be much better if I could choose what allocates to what. I.e. 2 campaign tokens to one site and 3 to another or just 5 to one site. Is this possible, and if not why not?
Moz Pro | | DaveDawson0 -
Issue in number of pages crawled
i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account). However after a few weeks, the number of pages crawled went down to about 5500. This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!
Moz Pro | | cchhita0 -
Which Moz Rank and I'm seeing External or both external and internal?
I found this on the MOZ site. It confused me. "Whereas MozRank measures the link juice (ranking power) of both internal and external links, external MozRank measures only the amount of mozRank flowing through external links (links located on a separate domain). Because external links can play an important role as independent endorsements, external mozRank is an important metric for predicting search engine rankings." In the tool bar and other places in Moz am I seeing the combo Internal or the External and how do I get to each? Maybe I'm just reading this wrong. 🙂
Moz Pro | | RustyF0