Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
"Duplicate without user-selected canonical” - impact to SERPs
-
Hello, we are facing some issues on our project and we would like to get some advice.
Scenario
We run several websites (www.brandName.com, www.brandName.be, www.brandName.ch, etc..) all in French language . All sites have nearly the same content & structure, only minor text (some headings and phone numbers due to different countries are different). There are many good quality pages, but again they are the same over all domains.Goal
We want local domains (be, ch, fr, etc.) to appear in SERPs and also comply with Google policy of local language variants and/or canonical links.Current solution
Currently we don’t use canonicals, instead we use rel="alternate" hreflang="x-default":<link rel="alternate" hreflang="fr-BE" href="https://www.brandName.be/" /> <link rel="alternate" hreflang="fr-CA" href="https://www.brandName.ca/" /> <link rel="alternate" hreflang="fr-CH" href="https://www.brandName.ch/" /> <link rel="alternate" hreflang="fr-FR" href="https://www.brandName.fr/" /> <link rel="alternate" hreflang="fr-LU" href="https://www.brandName.lu/" /> <link rel="alternate" hreflang="x-default" href="https://www.brandName.com/" />
Issue
After Googlebot crawled the websites we see lot of “Duplicate without user-selected canonical” in Coverage/Excluded report (Google Search Console) for most domains. When we inspect some of those URLs we can see Google has decided that canonical URL points to (example):User-declared canonical: None
Google-selected canonical: …same page, but on a different domainStrange is that even those URLs are on Google and can be found in SERPs.
Obviously Google doesn’t know what to make of it. We noticed many websites in the same scenario use a self-referencing approach which is not really “kosher” - we are afraid if we use the same approach we can get penalized by Google.
Question: What do you suggest to fix the “Duplicate without user-selected canonical” in our scenario?
Any suggestions/ideas appreciated, thanks. Regards.
-
The issue of "Duplicate without user-selected canonical" refers to situations where there are multiple identical or very similar pages on a website, but a canonical tag has not been explicitly set to indicate which version should be considered the preferred or original version by search engines.
The impact of this issue on search engine results pages (SERPs) can be negative for several reasons:
Keyword Dilution: When search engines encounter multiple versions of the same or similar content, they might have a hard time determining which page to rank for a particular keyword. This can lead to keyword dilution, where the authority and relevance of the content is spread across multiple pages instead of being concentrated on a single page.
Page Selection Uncertainty: Without a canonical tag to guide search engines, they may choose to index and display a version of the page that is not the most relevant or valuable to users. This can result in users landing on less optimal pages from their search queries.
Ranking Competition: Duplicate content can cause internal competition between your own pages for rankings. Instead of consolidating ranking signals onto one page, they get divided among duplicates, potentially leading to lower overall rankings for all versions.
Crawling and Indexing Issues: Search engine bots may spend more time crawling and indexing duplicate content, which could lead to inefficient use of their resources. This might affect how often your new or updated content gets indexed.
To address the "Duplicate without user-selected canonical" issue and mitigate its impact on SERPs:
Implement Canonical Tags: Set up canonical tags on duplicate or similar pages to indicate the preferred version. This guides search engines to consolidate ranking signals and direct traffic to the correct page.
301 Redirects: If possible, redirect duplicate pages to a single, canonical version using 301 redirects. This not only consolidates ranking signals but also ensures that users are directed to the most relevant content.
Consolidate Content: Consider merging similar pages into a single, comprehensive page. This helps avoid duplication issues and improves the overall user experience.
Use Noindex Tags: If some duplicate pages are not crucial for SEO or user experience, you can add a noindex meta tag to prevent search engines from indexing those pages.
Monitor and Update: Regularly audit your website for duplicate content and ensure that new content is properly canonicalized to prevent future occurrences.
By addressing the "Duplicate without user-selected canonical" issue, you can help improve the clarity and accuracy of how your content appears in SERPs, potentially leading to better rankings and a more effective SEO strategy.
-
@GeorgeJohn727
Duplicate without user-selected canonical -
Understanding 'Duplicate without user-selected canonical' is crucial for optimizing SERPs. This issue can lead to content duplication concerns, potentially affecting search engine rankings. Just as addressing this matter ensures streamlined search results, exploring the 'best online betting sites in India' exemplifies how selecting the right canonical source enhances visibility and credibility in the online domain.
-
- Even if this error occurs it doesn't mean Google ignores the pages - it can and in our case they appear in SERPs.
- Duplicate pages carry value in sense that there is a slight alteration for local market - contact info, different pricing, etc. So 90% of the page is same on national
domains, but only slight part differs.
-
@alex_pisa
The error "Duplicate without user-selected canonical” indicates that Google found duplicate URLs that are not canonicalized to a preferred version. Google didn't index these duplicate URLs and assigned a canonical version on its own.How to fix this issue
Should these pages even exist? If the answer to this is no, simply remove these pages and return a HTTP status code 410.
If these pages have a purpose, then ask yourself whether they
carry any value:-
If yes, then canonicalize them to the preferred version of the URL. Need some inspiration where to canonicalize to? See which URL Google finds most relevant using the URL Inspection tool(opens in a new tab). If Google's listing PDF files for your site, canonicalize them through the HTTP header.
-
If these pages don't carry any value, then make sure to apply the noindex directive through the meta robots tag or X-Robots-Tag HTTP Header.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Advise on the right way to block country specific users but not block Googlebot - and not be seen to be cloaking. Help please!
Hi, I am working on the SEO of an online gaming platform - a platform that can only be accessed by people in certain countries, where the games and content are legally allowed.
International SEO | | MarkCanning
Example: The games are not allowed in the USA, but they are allowed in Canada. Present Situation:
Presently when a user from the USA visits the site they get directed to a restricted location page with the following message: RESTRICTED LOCATION
Due to licensing restrictions, we can't currently offer our services in your location. We're working hard to expand our reach, so stay tuned for updates! Because USA visitors are blocked Google which primarily (but not always) crawls from the USA is also blocked, so the company webpages are not being crawled and indexed. Objective / What we want to achieve: The website will have multiple region and language locations. Some of these will exist as standalone websites and others will exist as folders on the domain. Examples below:
domain.com/en-ca [English Canada]
domain.com/fr-ca [french Canada]
domain.com/es-mx [spanish mexico]
domain.com/pt-br [portugese brazil]
domain.co.in/hi [hindi India] If a user from USA or another restricted location tries to access our site they should not have access but should get a restricted access message.
However we still want google to be able to access, crawl and index our pages. Can i suggest how do we do this without getting done for cloaking etc? Would this approach be ok? (please see below) We continue to work as the present situation is presently doing, showing visitors from the USA a restricted message.
However rather than redirecting these visitors to a restricted location page, we just black out the page and show them a floating message as if it were a model window.
While Googlebot would be allowed to visit and crawl the website. I have also read that it would be good to put paywall schema on each webpage to let Google know that we are not cloaking and its a restricted paid page. All public pages are accessible but only if the visitor is from a location that is not restricted Any feedback and direction that can be given would be greatly appreciated as i am new to this angle of SEO. Sincere thanks,0 -
Multilang site: Auto redirect 301 or 302?
We need to establish if 301 or 302 response code is to be used for our auto redirects based on Accept-Language header. https://domain.com
International SEO | | fJ66doneOIdDpj
30x > https://domain.com/en
30x > https://domain.com/ru
30x > https://domain.com/de The site architecture is set up with proper inline HREFLANG.
We have read different opinions about this, Ahrefs says 302 is the correct one:
https://ahrefs.com/blog/301-vs-302-redirects/
302 redirect:
"You want to redirect users to the right version of the site for them (based on location/language)." You could argue that the root redirect is never permanent as it varies based on user language settings (302)
On the other hand, the lang specific redirects are permanent per language: IF Accept-Language header = en
https://domain.com > 301 > https://domain.com/en
IF Accept-Language header = ru
https://domain.com > 301 > https://domain.com/ru So each of these is 'permanent'. So which is the correct?0 -
"Duplicate without user-selected canonical” - impact to Google Ads costs
Hello, we are facing some issues on our project and we would like to get some advice. Scenario
Paid Search Marketing | | Alex_Pisa
We run several websites (www.brandName.com, www.brandName.be, www.brandName.ch, etc..) all in French language . All sites have nearly the same content & structure, only minor text (some headings and phone numbers due to different countries are different). There are many good quality pages, but again they are the same over all domains. Current solution
Currently we don’t use canonicals, instead we use rel="alternate" hreflang="x-default": <link rel="alternate" hreflang="fr-BE" href="https://www.brandName.be/" /> <link rel="alternate" hreflang="fr-CA" href="https://www.brandName.ca/" /> <link rel="alternate" hreflang="fr-CH" href="https://www.brandName.ch/" /> <link rel="alternate" hreflang="fr-FR" href="https://www.brandName.fr/" /> <link rel="alternate" hreflang="fr-LU" href="https://www.brandName.lu/" /> <link rel="alternate" hreflang="x-default" href="https://www.brandName.com/" /> Naturally this si reflected in ""Duplicate without user-selected canonical” . Issue
We create the same ad in Google Ads for 2 domains. So the content is mostly identical, ads are identical, target URLs differ only in domain. Yet Google Ads “Quality score” is different (10/10 vs. 6/10) and “Landing page experience” is very different (Above average vs. Average). Some members of our team think lower “Landing page experience” increases the Google Ads costs, which I personally don't believe, but I want to double check. Question: Can “Duplicate without user-selected canonical” issue decrease the “Landing page experience” rating and as result can it cause higher Google ads costs? Any suggestions/ideas appreciated, thanks. Regards.0 -
Alternate page with proper canonical tag Status: Excluded in Google webmaster tools.
In Google Webmaster Tools, I have a coverage issue. I am getting this error message: Alternate page with proper canonical tag Status: Excluded. It gives the below blog post page as an example. Any idea how to resolve? At one time, I was using handl utm grabber, but the plugin is deactivated on my website. https://www.savacations.com/turrialba-costa-ricas-garden-city/?utm_source=deleted&utm_medium=deleted&utm_term=deleted&utm_content=deleted&utm_campaign=deleted&gclid=deleted5.
Intermediate & Advanced SEO | | Alancito0 -
Correct Hreflang & Canonical Tags for Multi-Regional Website English Language Only having URL Parameters
Dear friends, We have a multi-regional website in English language only having the country selector on the top of each page and it adds countrycode parameters on each url. Website is built in Magento 1.8 and having 1 store with multiple store views. There is no default store set in Magento as I discussed with developer. Content is same for all the countries and only currency is changed. In navigation there are urls without url parameters but when we change store from any page it add parameters in the url for same page hence there are total 7 URLs. 6 URLs for each page (with country parameters) and 1 master url (without parameters) and making content duplicity. We have implemented hreflang tags on each page with url parameters but for canonical we have implemented master page url as per navigation without url parameters Example on this page. I think this is correct for master page but we should use URL parameters in canonical tags for each counry url too and there should be only 1 canonical tag on each country page url. Currently all the country urls are having master page canoncial tag as per the example. Please correct me if I am wrong and **in this case what has to be done for master page? **as google is indexing the pages without parameters too. We are also using GEOIP redirection for each store with country IP detection and for rest of the countries which are not listed on the website we are redirecting to USA store. Earlier it was 301 but we changed it to 302. Hreflang tags are showing errors in SEMRush due to redirection but in GWT it's OK for some pages it's showing no return tags only. Should I use **x-default tags for hreflang and country selector only on home page like this or should I remove the redirection? **However some of the website like this using redirection but header check tool doesn't show the redirection for this and for our website it shows 302 redirection. Sorry for the long post but looking for your support, please.
International SEO | | spjain810 -
How to avoid duplication across multiple country domains
Here's the scenario: I have a client currently running one Shopify site (AU) They want to launch three more country domains (US, UK and EU) They want each to be a standalone site, primarily so the customers can purchase in their local currency, which is not possible from a single Shopify site The inventory is all from the same source The product desscriptions will all be the same as well Question: How do we avoid content duplication (ie. how will canonical tags work in this scenario)?
International SEO | | muzzmoz0 -
Redirecting users based on location
My site is available in EN, DE, SW, SP, FR, IT, CH and JP. However, the EN sites ranks much better than the other languages, and even when searching in another language the EN homepage is normally the result that appears. Would it be worthwhile to automatically redirect users to the site in the same language they are searching in or country they are searching from? If so, how do I go about this? Thanks!
International SEO | | theLotter0 -
Do non-english(localized) URLs help Local SEO and user experience?
Hi Everyone, This question is about URL best practice for multilingual websites. We have www.example.com in English and we are building the exact replica of English site in German www.example.de. On the Geman site, we are considering to translate some portions of the URLs for example last folder and file name as seen below: example.de/folder1-in-english/folder2-in-english/folder3-in-german/filename-in-german.html Is this a good idea? Will this help SEO and user experience both? or the mixed languagues in URL will confuse the users? Google guidelines say that this should be ok. Would love to get feedback from SEOMOZ community! Thanks, Supriya.
International SEO | | Amjath0