Should I be running my crawl on our www address or our non-www address?
-
I currently run our crawl on oursitename.com, but am wondering if it should be run on www.oursitename.com instead.
-
It does make sense. Based on what you wrote, ours is not set up correctly. But now I have the language to better work with our provider.
You are very helpful!! Thank you!
-
There's really no way to avoid the existence of the two different addresses, THMCC - they're a byproduct of the way of the way web servers and domain names work. They both exists as soon as a website is created. And visitors tend to use them interchangeably.
They aren't "actually" two different sites, they are just two different addresses that refer to the same pages, causing the search engines to see them as duplicate content. Kind of like how your house's location can be described by the lot number on the city plan, or by the postal address. Same house - different ways of showing where it's located.
If the 301 redirect is done correctly, the search engines will understand that everything should be considered to be at the one primary address and they'll pass along the other version's authority to the primary version automatically. And therefore no second version to compete with.
You can easily tell if the redirect is working properly. Let's assume you decide for example that the www.thmedicalcallcenter.com version is the primary and redirect the non-www version to it. When you type in the non-www address into the browser's address bar and hit enter, you should actually see the URL in the address bar change to the www version of the address.
And yea, you absolutely must have both addresses taken care of. You have no way of controlling whether someone types in the address with or without the www. and you want either one to get forwarded on to the primary address.
Does that all makes sense?
Paul
-
Thanks so much, Paul!!
The SEO Moz helpdesk is who told me that I needed to have oursitename.com in addition to www.oursitename.com. Is this true? Creating oursitename.com and the redirect seems to have caused a lot of errors, mostly duplicates from the redirect probably not being done correctly. But overall, was/is it in our best interest to have both www.oursitename.com and oursitename.com?
-
Thanks again!! One more question if you don't mind. If the 301 redirect is done correctly will this fix the competition issue in all the search engines? If not, should I get rid of oursitename.com?
-
As far as the search engines are concerned, thmedicalcallcenter.com and www.thmedicalcallcenter.com are two separate sites that will compete against each other and dilute each others' authority and ranking unless one is 301-redirected to the other.
As SEO5 indicates, it's best to assess which version already has the most incoming links and use that version as the primary, redirecting the other one to it.
This is best done using a 301 redirect written into your site's .htaccess file. In addition, there is spot in Google Webmaster Tools (GWT or WMT) where you can also hint to Google which version of the site you want to be the primary.
It's not enough to only use the hint in GWT as that only applies to Google, it will do nothing to correct the problem in the other search engines.
Paul
-
I thought they were the same...with a 301 redirect from oursitename to www.oursitename.com so I am confused as to why one would have more inbound links than the other. Also, what is WMT?
Thanks!!!
-
Pick the one that has more inbound links associated with it and already has high pages in the index. Make sure you set the preferences in WMT to either the www. or the non www version.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz Pro crawl signaling missing canonical which are not?
Hi,
Moz Pro | | rolandvintners
I'm trying MozPro considering using it.
One of the tool which is appealing is the crawl and insights.
After quick use, I really question many of the alerts, for instance, I got a "missing canonical tag" on this url: https://vintners.co/wine/grawu_gto#2020 but when I check my markup, there's clearly a canonical tag: <link rel="canonical" href="https://vintners.co/wine/grawu_gto"> Anybody can explain?
I asked Moz Pro staff when being onboarded but didn't get an answer...
Honestly, I'm questioning the value of these crawls, or may be I miss something?0 -
Possible Crawling Problem with Screaming Frog and Moz Crawlers
So I'm not sure if what I'm seeing is a problem or not. As of about two weeks ago the Moz crawler has only been able to see www.mysite.com, and none of the links, content, title, ect associated with the page. Essentially the report has one line, what should be the homepage, but it's not able to pull any information from the page but does show a 200 http status code. The report shows nothing blocked by robots or any errors. When I use screaming frog to crawl the site about 75% of the time it just reports one line www.mysite.com with a 200 status code, but again the crawler is not able to actually see the html. The other 25% of the time it works perfectly fine, crawls all pages and sees all meta info and content. There are no errors in Google WMT and everything looks ok there. We have seen a traffic drop the last two weeks but I don't know if this is the reason for it. I can't publicly post the page but if someone has an idea of what might be going on I'd be happy to PM them. Thanks
Moz Pro | | CJ50 -
Crawl diagnostics up to date after Magento ecommerce site crawl?
Howdy Mozzers, I have a Magento ecommerce website and I was wondering if the data (errors/warnings) from the Crawl diagnostics are up to date. My Magento website has 2.439 errors, mainly 1.325 duplicate page content and 1.111 duplicate page title issues. I already implemented the Yoast meta data plugin that should fix these issues, however I still see there errors appearing in the crawl diagnostics, but when going to the mentioned URL in the crawl diagnostics for e.g.: http://domain.com/babyroom/productname.html?dir=desc&targetaudience=64&order=name and checking the source code and searching for 'canonical' I do see: http://domain.com/babyroom/productname.html" />. Even I checked the google serp for url: http://domain.com/babyroom/productname.html?dir=desc&targetaudience=64&order=name and I couldn't find the url indexed in Google. So it basically means the Yoast meta plugin actually worked. So what I was wondering is why I still see the error counted in the crawl diagnostics? My goal is to remove all the errors and bring it all to zero in the crawl diagnostics. And now I am still struggling with the "overly-dynamic URL" (1.025) and "too many on-page links" (9.000+) I want to measure whether I can bring the warnings down after implementing an AJAX-based layered navigation. But if it's not updating it here crawl diagnostics I have no idea how to measure the success of eliminating the warnings. Thanks for reading and hopefully you all can give me some feedback.
Moz Pro | | videomarketingboys0 -
Has the Crawl Test gone?
Just checked the new Moz, am I right in thinking the super useful crawl test functionality has gone? I use it for existing sites to download all the title tags and meta name descriptions, is there more to come??
Moz Pro | | Karen_Dauncey0 -
Crawl Errors and Notices drop to zero
Hi all, After setting up a campaign in Moz the crawl is successful and it showed the Errors and Warnings in crawl diagnostics (each one had about 40-50), but after a few days the number dropped to zero. Only the "notices" seems to stay normal, with a slight drop since the campaign set up, but not dropping to zero. I set this campaign up in a colleague's account and the same thing happened shortly after set up. I didn't find any Q&A already posted so any insight is appreciated!
Moz Pro | | Vanessa120 -
Campaign Crawl
I have a site with 8036 pages in my sitemap index. But the MozBot only Crawled 2169 pages. It's been several months and each week it crawls roughly the same number of pages. Any idea why I'm not getting fully crawled?
Moz Pro | | JMFieldMarketing0 -
How can I cancel a running crawl test?
I put in two urls that were incorrect and now I need to cancel the report generation. Is there a way to do this? And if so, would I get my crawl-credits back? Are they cumulative?
Moz Pro | | krenerr0 -
Does the SEOMoz weekly crawl that highlights no meta description tag, take into account if there is a meta robots noindex,follow tag on the pages it indicates the missing meta descriptions?
The weekly crawl website report is telling me that there are pages that have missing meta description tags, yet I've implemented meta robots tags to 'noindex, follow' those pages which are visible in those page source files. As far as Google Is concerned, surely this then won't be a problem since it is being instructed NOT to consider these specific pages for indexing. I am assuming that the weekly SEOmoz website crawl is simply throwing the missing meta description crawl findings into its report without itself observing that the particluar URL references contain the meta robots 'noindex,follow' tag ???? Appreciate if you can clairfy if this is the case. It would help me understand that (at least in terms of my efforts towards Google) your own crawl doesn't observe the meta robots tag instruction, hence the resultant report's flagging the discrepancy.
Moz Pro | | callassist0