Can I see when SEO Moz has crawled my website?
-
I would like to know if it's possible to see (maybe in my Google Analytics) if SEO Moz has crawled my website.
I'm also curious if and where I can see when the robot of Google visited my website.
Thanks!
-
Thanks Megan and Martijn for your quick reply! They were both helpful
-
Hi Simone! This is Megan from SEOmoz. Your best option to see what bots have crawled your site and when is by checking your server logs. If our bot came through, you'll see our useragent 'rogerbot'.
Hope this helps!
-
Hi Simone,
You're as far as I know not able to see when Rogerbot crawled your site from within SEOMoz. You should be able to see when Googlebot visits your site from within Google Webmaster Tools. They provided crawl stats to see how many pages Googlebot visited.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ahrefs vs Moz
Hi! I noticed the Moz DA en the Ahrefs DA are very different. Where https://www.123opzeggen.nl/ has a DA of 10 at MOZ, the DA at Ahrefs is 26. Where does this big difference come from? Do you measure in different ways? I hope you can answer this question for me. Thank you in advance!
Moz Pro | | NaomiAdivare2 -
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
Can you see changes in page authority quarterly?
Is there any definitive answer to when page authority can change? I'm trying to see if it's a trackable metric but not sure since (I believe) it's something that takes time. Is there any article/reference that speaks to the fact that the page authority can take time to change? I do know that changes to the page, competitors pages and a multitude of factors go into the score, but I'm trying to see if there is a 'simple' answer for the timing of the scoring.
Moz Pro | | AvexHomes0 -
Does CNAME impact SEO?
I've recently brought on Pardot. For Campaign ROI tracking, I'm supposed to add a CNAME (I'm using .go) with /source to each source of possible first touches, like Google My Business or an industry directory. For example, to track referrals and $ROI from a directory, I'm supposed to use go.myURL.com/directoryname. Does using go. and /source have a negative impact on my SEO? Thanks for your help.
Moz Pro | | Beau_W0 -
Has the Crawl Test gone?
Just checked the new Moz, am I right in thinking the super useful crawl test functionality has gone? I use it for existing sites to download all the title tags and meta name descriptions, is there more to come??
Moz Pro | | Karen_Dauncey0 -
Campaign. Only 1 page is crawled
I have a campaign setup a couple weeks ago and noticed that only 1 page has been crawled. Is there something I need to do to get all pages crawled?
Moz Pro | | priceseo0 -
How can I see the URL's affected in Seomoz Crawl when Notices increase
Hi, When Seomoz crawled my site, my notices increased by 255. How can I only these affected urls ? thanks Sarah
Moz Pro | | SarahCollins0 -
OpenSiteExplorer is not seeing all my inbound links
I know I have back links to my site from about 5 or 6 websites and most of them even show in my Google webmaster account but according to OSE I only have 1 inbound link. Is it normal for the OSE stats to be wrong? I really want to use it but am worried the info isn't going to be accurate.
Moz Pro | | JasonHegarty0