Domain Crawl Question
-
We have our domain hosted by two providers - web.com for the root and godaddy for the subdomain. Why SEOMOZ is not picking up the total pages of the entire domain?
-
This was their answer.
Hello There!
Thanks for writing in and sorry you're getting this problem.
Unfortunately, this might all be due to the fact that your campaign is based on the subdomain http://www.example.com versus the root domain http://example.com. Since the root domain is what is ranking in the engines and is where all of the pages are hosted, including your blog, you're not getting results on those pages or rankings. Instead, you're getting information based on only the pages and rankings that are connected to http://www.example.com.
Unfortunately, the only way to solve this is to start up a new campaign based on the root domain http://example.com. After you set everything up in that campaign, you should begin to get crawl data within three to seven days, and everything should be peachy-keen! You'll have a plethora of juicy data that you weren't getting before on the http://www.example.com subdomain.
I hope that helps!
-
Hi Timothy,
This is either in the configuration on your end or an issue with the way Roger crawls, and it'd be best handled by the help desk. Could you send them an email at help@seomoz.org with your info and they'll help get you sorted out? Thanks so much!
Keri
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Old domain to new domain
Hi, A website on server A is no longer required. The owner has redirected some URLS of this website (via plugin) to his new website on server B -but not all URLS. So when I use COMMAND site:website A , I see a mixture of redirected URLS and not redirected URLS.Therefore two websites are still being indexed in some form and causing duplication. However, weirdly when I crawl with Screaming Frog I only see one URL which is 301 redirected to the new website. I would have thought I'd see lots of URLs which hadn't been redirected. How come it is different to using the site:command? Anyway, how do I move to the new website completely without the old one being indexed anymore. I thought I knew this but have read so many blogs I've confused myself! Should I: Redirect all URLS via the HTACESS file on old website on server A? There are lots of pages indexed so a lot of URLs. What if I miss some? or Point the old domain via DNS to server B and do the redirects in website B HTaccess file? This seems more sensible but does this method still retain the website rankings? Thanks for any help
Technical SEO | | AL123al0 -
.htaccess redirect question
Hi guys and girls Please forgive me for being an apache noob, but I've been trawling for a while now and i can't seem to find a definitive guide for my current scenario. I've walked into a but of a cluster$%*! of a job, to rescue a horribly set up site. One of many, many problems is that they have 132 302redirects set up. Some of these are identical pages but http-https, others are the same but https-http and some are redirects to different content pages with http-http. A uniform redirecting of http to https is not an option so I'm looking to find out the best practice for reconfiguring these 302s to 301s within .htaccess? Thanks in advance 🙂
Technical SEO | | craig.gto0 -
Does a sub-domain benefit a domain...
I have seen some mixed comment as the whether a sub-domain would benefit from the authority built up by its domain... but does a domain benefit from a sub-domain?
Technical SEO | | Switch_Digital0 -
Umlaut in domain
Hi, My client wants to expand it's business to Germany and logically we need a domain name to match. We've found a great one and regsiterd several variants to it. However I just found out that in Germany it is possible (while here it's not) to register a domain with an umlaut. My question is: will google assign more value to: schädlinge.de than schadlinge.de when users search for schädlinge? If yes, how large will the difference be? (I will use an umlaut in the title etc) Kind regards,
Technical SEO | | media-surfer
Jason.0 -
Robots.txt question
What is this robots.txt telling the search engines? User-agent: * Disallow: /stats/
Technical SEO | | DenverKelly0 -
How to increase the crawl rate?
hello, Our site was hosted in North America and Google was crawling it reasonably fast. Since our traffic is mostly from India we moved it to India, now the crawling is terribly slow from Google. Is there anyway to fix the crawl rate(we have increased the crawl rate in GWT)
Technical SEO | | greyniumseo0 -
Two spelling of a domain
I have a customer with two spellings of their domain name. I set up an account for spelling A and forwarded all the email boxes to spelling B becuase people tend to remember spelling A more of the time. Spelling B is the real web site. I also want any www. traffic for spelling A to go to spelling B so I used this .htaccess file in the root of spelling A Options +Indexes +FollowSymLinks
Technical SEO | | freestone
RewriteEngine On
RewriteRule ^(.*)$ http://www.B.com/$1 [R=301,L] I use to just forward A to B from the registrar but made this change to allow for email spelled either way. My question is does this create a duplicate site issue for the bots? Is this in anyway an SEO negative and if so is there a better way to do this. Thanks jw0 -
Sitemap question
My sitemap includes www.example.com and www.example.com/index.html, they are both the same page, will this have any negative effects, or can I remove the www.example.com/index.html?
Technical SEO | | Aftermath_SEO0