Massive increase in Moz crawl.
-
I have a subdomain which has just started to be crawled by Moz, Previously this wasn't the case.
The sub-domain had 16,000+ issues. Why has Moz started to count sub-domains as part of the main domain, has Google started to do this aswell?
-
Hi Dave!
Thanks for reaching out! My name is Anne, and I helping the Mozzer Alliance today! There could be a few different reasons we've just started crawling this subdomain:
1. Did you recently link this subdomain to your site differently? Our crawler starts with your home page and uses recursive crawling to find pages on your site through the links we find. This could explain why we just started crawling the subdomain.
2. Did you change your robots.txt for this subdomain? Our crawler, Rogerbot, follows robots.txt. If you edited this site recently, this could also explain why we just started crawling your subdomain.
I hope this helps! If you have more questions, please reach out to the help team at https://moz.com/help/contact. From there we can help you troubleshoot what's going on, but keep your campaign details off the interwebz.
Have a great weekend!
Anne
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
The links pointed to a multilanguage site, should increase the DA? (Wordpress question inside)
We are planning to make our site available to several language, using the plugin WPML in Wordpress. The site should look with /es/, /fr, etc. If someone point to an URL in the spanish version, the english version get any benefit from it? (better search ranking or something like that). Some side question: WPML works fine with SEO and Moz?
On-Page Optimization | | carlostinca0 -
I am trying to better understand solving the duplicate content issues highlighted in your recent crawl report of our site - www.thehomesites.com.
Below are some of the urls highlighted as having duplicate content -
On-Page Optimization | | urahul
http://www.thehomesites.com/zip_details/76105
http://www.thehomesites.com/zip_details/44135
http://www.thehomesites.com/zip_details/75227
http://www.thehomesites.com/zip_details/94501 These are neighborhood reports generated for 4 different zip codes. We use a standard template to create these reports. What are some of the steps we can take to avoid these pages being categorized as duplicate content?0 -
Grade F page on Moz positions No 1 on Google Keywords not contained
Hi I am trying to understand why a page list in position 1 on Google despite the fact it does not include the search terms anywhere in the page source. One of our sites has been in that position for years has great content and links for the key word terms so how can the other page overtake it and all of the other keywords without so much as a sniff of the keyword in the URL, Meta, content or images. It grades F on Moz! How can I discover the technique that has been used. This really is black art stuff or do Google accept payment from major corporations to list their pages irrespective of content?
On-Page Optimization | | Eff-Commerce0 -
Moz shows page has no meta description but it does
Hi We recently worked on optimising one of our product pages, we created a new meta description, new unique content and a ensured it was optimised for our keyword. Despite all of this its ranking is still significantly lower than competitors eventhough the page authority is as good as theirs. I have just noticed that Moz crawl diagnostics is showing it up as having no meta description - but it does! when you check the source you see:http-equiv="description" content="Buy the robust and reliable Canon imageRUNNER 2525 from Copyfaxes. Learn more about the Canon 2525 before you buy." /> The page is: http://copyfaxes.com/product/2552/Canon-ImageRunner-2525-Digital-Copier I would appreciate any ideas.
On-Page Optimization | | copyfaxes10 -
Blocking Subdomain from Google Crawl and Index
Hey everybody, how is it going? I have a simple question, that i need answered. I have a main domain, lets call it domain.com. Recently our company will launch a series of promotions for which we will use cname subdomains, i.e try.domain.com, or buy.domain.com. They will serve a commercial objective, nothing more. What is the best way to block such domains from being indexed in Google, also from counting as a subdomain from the domain.com. Robots.txt, No-follow, etc? Hope to hear from you, Best Regards,
On-Page Optimization | | JesusD3 -
Using Subdomains to Increase Keyword Density?
I have a website on which I publish lots of news (sometimes up to 10 posts per day). I have a feeling that somewhat it is diluting the density of some keywords I am targeting. By using subdomains, would I avoid diluting keyword density too much? Of course, I am talking about a reasonable use of subdomains (maybe 1 or 2). What's your opinion?
On-Page Optimization | | sbrault740 -
Website pages missing from seomoz crawl
Hi! I just added a website and the crawling result output has only 42 pages but my website has about 75 pages. What am i missing? Thanks!
On-Page Optimization | | ovieira0 -
How long should I wait before making changes to my new site in order to increase ranking?
I just create a site www.autoinsurancefremontca.com. It has been about a week since this site has been launched. The site currently resides at 12th position on google. With Semoz it has a Site Grade Of "A" . When should I start making changes to the site like adding a content as an example to increase my ranking. I am trying to get this site on the first page with google. Please help!!
On-Page Optimization | | Greenpeak0
