Site re-crawled?
-
I've fixed many of my errors, but they're still showing in my dashboard. When will the site be crawled again?
-
Hi there! This is Megan from SEOmoz. Sites in campaigns are crawled once per week. The completion day of your crawl depends on when your campaign was set up. If you need a crawl in between your regularly scheduled crawls, you can check out our crawl test tool - http://pro.seomoz.org/tools/crawl-test
Just a heads up that the crawl test tool uses cached data from the campaign crawl for about 2-3 days after the campaign crawl has been completed, so you might have to wait a bit to get new crawl results.
I hope this helps!
-
I believe sites are recrawled every 7 days, I want to say it happens on Wednesdays but I could be wrong on that.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Losing referrer data on http link that redirects to an https site when on an https site. Is this typical or is something else going on here?
I am trying to resolve a referral data issue. Our client noticed that their referrals from one of their sites to another had dropped to almost nothing from being their top referrer. The referring site SiteA which is an HTTPs site, held a link to SiteB, which is also an HTTPs site, so there should be no loss, however the link to SiteB on SiteA had the HTTP protocol. When we changed the link to the HTTPs protocol, the referrals started flowing in. Is this typical? If the 301 redirect is properly in place for SiteB, why would we lose the referral data?
Reporting & Analytics | | Velir0 -
Same person on my site, every day, for over 6 months??
I watch my Google analytics real time while I work and for the last 6 months, I've had one person on my site consistently during every Monday to Friday. It's only the home page there go on, it never shows they look anywhere else. But it's starting to concern me a little since it's been going on for so long. Does anyone have an idea what they could be doing? I do my own SEO, there is no one else working on my site. Thanks in advance!
Reporting & Analytics | | Coppell0 -
Longterm wordpress blog not providing seo benefit to main site - help needed please
Hi I have a bigcommerce ecommerce store, with a Wordpress blog on a subdomain. The store and blog have been active for four years, the blog is regularly updated with original content, has many links to the store, is promoted regularly via my brand's social media channels and mailing list, and has the simplest SEO basics covered via a Yoast SEO plugin. But the store sees very little, if any, SEO benefit from the blog. My question is: based on this information, and the details below, is there an issue with the connection between the blog and main site in SEO terms? And if there is, how can I start fixing it? Further info: 1 In my Moz dashboard for the store site, the blog does not show at all as providing any inbound links or linking domains 2 Google Analytics also shows zero referral traffic to the store site from the blog since April 2015 3 Moz crawl issues is flagging ‘duplicate page content issues’ for pretty much every page of the blog, and the analysis provided suggests this may be related to tags but I have only basic SEO knowledge and am fast getting out of my depth here. 4 I have today altered the settings within the Yoast plugin on the blog to ‘noindex’ for Tags, Meta Robots, based on advice I have found in this section but am already well over my head and unsure even this is correct. An agency have been running SEO for the store since 2012 but since uncovering how little they have done in this time for the money paid, I am now taking matters back into my own hands. However I am on a very steep learning curve and this one is beyond me right now - please does anyone have any suggestions where I can start looking to uncover the root issue? Any guidance or advice would be greatly appreciated Thanks very much and hope to hear from someone!
Reporting & Analytics | | Warren_331 -
Google Crawl Stats
Hi all Wondering if anyone could help me out here. I am seeing massive variations in WMT of google crawl stats on a site I run. Just wondering if this is normal (see attached image). The site is an eccommerce site and gets a handful of new products added every couple of weeks. The total no of products is about 220k so this is only a very small %. I notice in WMT I have an amber warning under Server connectivity. About 10 days back I had warnings under DNS, Server and Robots. This was due to bad server performance. I have since moved to a new server and the other two warnings have gone back to green. I expect the Server connectivity one to update any day now. Ive included the graph for this incase it is relevant here. Many thanks for assistance. Carl crawlstats.png connect.png
Reporting & Analytics | | daedriccarl0 -
Dip in traffic from Pune for our sites in Google Analytics
Hi, We have noticed dip in traffic from Pune after 6th May'14 in our Google Analytics account for few of our sites. Did anyone noticed the same for your site. Kindly let me know if you have any idea. Thank and Regards
Reporting & Analytics | | vivekrathore0 -
Re-Launched Website: Developer Fogot to Remove noindex tags.
Our company's website has maintained decent rankings for the last 12 years we've been in business for our primary keywords. We recently had our website rebuilt from the ground up, and the developers left the noindex tags on all of our 400+ pages when we launched it. I didn't catch the error for 6 days. During which time, I used the Fetch feature in Google, submitting a site-wide fetch, as well as manual submissions for our top 100 URLs . In addition, every page that was indexed previously had a 301 set up for it, which was pointing to a destination with a noindex.
Reporting & Analytics | | yogitrout1
I caught the error today, and the developer removed the tags. Does anyone have any experience with a situation similar to this? In the SERPs, we are still ranking at this moment, and it's displaying our old URLs, and they are 301 redirecting just fine. But, what happens now? For 6 full days, we told Google not to index any of our pages, while also using the Fetch feature, contradicting ourselves.
Any words of wisdom or advice as to what I can do at this point to avoid potential fall out? Thanks0 -
Google Analytics Site Search to new sub-domain
Hi Mozzers, I'm setting up Google's Site Search on a website. However this isn't for search terms, this will be for people filling in a form and using the POST action to land on a results page. This is similar to what is outlined at http://support.google.com/analytics/bin/answer.py?hl=en&answer=1012264 ('<a class="zippy zippy-collapse">Setting Up Site Search for POST-Based Search Engines').</a> However my approach is different as my results appear on a sub-domain of the top level domain. Eg.. user is on www.domain.com/page.php user fills in form submits user gets taken to results.domain.com/results.php The issue is with the suggested code provided by Google as copied below.. Firstly, I don't use query strings on my results page so I would have to create an artificial page which shouldn't be a problem. But what I don't know is how the tracking will work across a sub-domain without the _gaq.push(['_setDomainName', '.domain.com']); code. Can this be added in? Can I also add Custom Variables? Does anyone have experience of using Site Search across a sub-domain perhaps to track quote form values? Many thanks!
Reporting & Analytics | | panini0 -
Unable to use Open Site Explorer
I have repeatedly tried to use Open Site Explorer on a site. I always get the same response: No Data Available for this URL The site is 4 months old. It is listed by Alexa in 1.3 million page category. The site ranks well on numerous key terms for the industry it covers. OSE offers 4 reasons for not having data: 1. Recency of page creation. In the explanation offered 45-60 days is the longest estimate it should take. The site has been live close to 120 days. 2. Deep down in the web. The tool doesn't even have any data for the site's home page. 3. Blocked pages. The site is listed in Google and these pages are not blocked. 4. No links. There are plenty of links. Site url is www.terapvp.com What can I do to fix this issue and get data?
Reporting & Analytics | | RyanKent0