Can Sitemap Be Used to Manage Canonical URLs?
-
We have a duplicate content challenge that likely has contributed to us loosing SERPs especially for generic keywords such as "audiobook," "audiobooks," "audio book," and "audio books."
Our duplicate content is on two levels.
1. The first level is at our web store, www.audiobooksonline.com.
Audiobooks are sometimes published in abridged, unabridged, on compact discs, on MP3 CD by the same publisher. In this case we use the publisher description of the story for each "flavor" = duplicate content.
Can we use our sitemap to identify only one "flavor" so that a spider doesn't index the others?
2. The second level is that most online merchants of the same publisher's audio book use the same description of the story = lots of duplicate content on the Web.
In that we have 11,000+ audio book titles offered at our Web store, I expect Google sees us as having lots of duplicated (on the Web) content and devalues our site.
Some of our competitors who rank very high for our generic keywords use the same publisher's description.
Any suggestions on how we could make our individual audio book title pages unique will be greatly appreciated.
-
Your sitemap.xml can't be used to solve this issue, Larry. The sitemap is only used to tell the search engines which pages exist on the site, not what to do if many of those pages share similar content.
In your case, likely the best approach is to use the rel=canonical tag to inform the search engines that you aware that the different formats of the audiobooks share similar descriptions, and to pick one format to be the primary page. Once you've determined the primary page, the other formats' pages would use the canonical tag in their headers to point to the primary page.
This essentially tells the search engines "these other pages are useful to the user, so I don't want to hide them, but they are really variations of the primary page, so assign all their value to the primary page, please".
This process is only a suggestion to the search engines, but it is usually heeded. The only real alternative would be to combine all the different format pages into one page with a description of the book, then listing the other formats and their prices. Kinda doubt your eCommerce system would allow this "out of the box". (You would then 301-redirect all the other format pages to the new main page.)
As for the fact that the book descriptions are the same as the publisher's and all the other sites - the only way around this is to write your own custom descriptions. There are many reasons the other sites could be ranking well even with those duplicate descriptions, ranging from better overall site authority, to having been online longer, to having better, more powerful incoming links.
It's a tough spot to be in, but you could start by rewriting the descriptions for, say, the top 25 books (according to your Analytics and your own instincts for which ones are the most valuable sales) and see if that results in an improvement to rankings and conversions.
One other way to beat the duplicate content in this case would be to get customers to leave reviews which are included on each page. These reviews would be different from other sites, making the overall content look different to the search engines. But this is also a lot of work to get to scale up as your customers must be encouraged to come back to your site at a later date to leave the review.
Hope that helps;
Paul
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keywords used to land on specific page?
Hi all, Does anyone know if there's anywhere where I can see what keywords are used in search engines to land on a specific page? I have access to the Google Analytics account and linked it to Moz as a campaign, but I can't find this data. I'm curious about this because a very uncommon word is used in a page title for a page I try to optimize. It's the Dutch translation of 'malicious'. And now I wonder if it's better to switch to a word that's used more often. Or if it's better to 'win the battle' on this (probably) rarely used word. I've used Google trends to see how many people use it, but it says there's not enough data to show the interest over time.
On-Page Optimization | | RaoulWB0 -
Canonicals
I dynamically generated pages using rewrite functions in wordpress (new-york, san-diego, san-francisco). All these pages look the same but with different content. yoast (seo wordpress plugin) was unaware of this and set canonicals up relating to the wordpress page used as the template page for the dynamic pages (City_home_page). so all these pages had the canonical https://dinnerdancecruises.com/City_Home_Page. using search console, i saw google indexed my site, looked at all these dynamically created pages (which is about 30 pages) and took them all in as duplicate pages. this happen sometime in april or may. I fixed this problem and set unique canonicals up for each dynamically created page. but now google is not crawling them for some reason. im not sure why its been months and these pages are not indexed. i thought to myself is it because these links end up on multiple pages? sort of like having "terms of agreement" link at the footer. every single page has that terms of agreement link. does google look at those links as duplicates and not index the page at all. this is where my issue lies. i need google to crawl regularly and see those pages with their new, unique canonicals and re-index them correctly. but it seems to save cpu resources, google feels once a thief always a thief. i could be wrong but this is why i need your suggestion. thank you.
On-Page Optimization | | bobperez7360950 -
Homepage canonical url with splash or not with splash? All other links are without but logo links with splash
Hello, There is so much contradicting information about the homepage canonical URL. Many websites have all the links without the trailing splash but their homepage URL still contains the splash. Now Moz is an example with this. Their urls don't have the splash, and their canonical does not have the splash. Why is it so and why so much different ways people have it?
On-Page Optimization | | advertisingcloud0 -
Use External Links
Hey 🙂 I noticed when analysing my pages that Moz gives the following advice about adding external links to my articles; "On any page specifically targeting a keyword, link externally to at least one (and possibly more than one) relevant, trusted resources as a best practice." As a small business I work pretty damn hard to get visitors to my website, so why on earth would I want to go to all that trouble just to send them away again to a trusted resouce? Secondly, what exactly is a "trusted resource"? Can I simply use search and use the top competitor, for example Moz or Wikipedia and does the anchor need to be an exact match or will a partial suffice. I say this because I already have the top spot for my longtail, so an exact match would be pointless. And lastly, I notice that pretty much all quality sites use external links to open in the same window i.e. not target=_blank, I never thought of it before today, but now that I'm considering using external linking in my articles I guess it's important to know the answer - i.e. Is this a best practice and does this give any seo benefit? Cheers, Lee :)
On-Page Optimization | | LeeC0 -
URL Path. What is better for SEO
Hello Moz people, Is it better for SEO to have a URL path like this: flowersite.com/anniversary_flowers/dozen_roses OR flowersite.com/dozen_roses Is it better to have the full trail of pages in the URL?
On-Page Optimization | | CKerr0 -
Using a subdomain to improve rankings
I have a pretty simple landing page that at present targets several keywords. Is a good strategy to add a blog to the site on a subdomain with pages targeting individual keywords? Will this help the main domain rank? Also is the best strategy to focus on building links to the home page or individual pages on the subdomain? As long as each page on the subdomain links back to the home page it should pass link juice back to the home page shouldn't it? Thanks in advance!
On-Page Optimization | | SamCUK0 -
Keyword use in meta description
Anyone know if its important that the target keyword is used AT THE START of the meta description, or is it enough that it is anywhere in the description...? I have a few big ones that are at the end of the description and I was wondering if I should move them up to the front... Thanks!
On-Page Optimization | | inhouseninja0 -
Would it be bad to change the canonical URL to the most recent page that has duplicate content, or should we just 301 redirect to the new page?
Is it bad to change the canonical URL in the tag, meaning does it lose it's stats? If we add a new page that may have duplicate content, but we want that page to be indexed over the older pages, should we just change the canonical page or redirect from the original canonical page? Thanks so much! -Amy
On-Page Optimization | | MeghanPrudencio0