Duplicate URL's in Sitemap? Is that a problem?
-
I submitted a sitemap to on Search Console - but noticed that there are duplicate URLs, is that a problem for Google?
-
Hi Luciana! If Logan and/or Matthew answered your question, mind marking one or both of their responses as a "Good Answer" (down in the lower-right of the responses)? It helps us keep track of things, and it gives them a few extra MozPoints.
-
Thank you everyone!
Basically for some reason the system I used to generate the sitemap just has some (not a whole lot) of duplicate URLs, they are exact duplicates. I figured Google would just overlook that.
This was helpful!
Thanks again,
Luciana
-
Generally speaking, this isn't the worst problem you can have with your XML sitemap. In an ideal world, you'll be able to remove duplicate URLs from the sitemap and only submit a single URL for each page. In reality, most larger sites I've encountered have some amount of duplicate content in their XML sitemap with no real major problems.
Duplicate content is really only a major problem if it is "deceptive" in nature. So long as this is just a normal consequence of your CMS, or similar, vs. an attempt to game the rankings you are probably fine. For more about that check out this support article.
The other problem you may encounter is with your search results for those duplicate pages. That article makes mention that Google will pick the URL they think is best (more about that here as well) and the URL they deem the best will be the URL that surfaces in the search results. That may or may not be the same URL you or your visitors would deem best. So, what you might find is Google picked a not great URL (like one with extra parameters) and with the not great URL appearing in the SERPs, your search result isn't as compelling to click on as some other version of the URL may be.
-
Hi,
This isn't necessarily a problem, but XML sitemaps should be as clean as possible before they're uploaded. i.e., no 301'd URLs, no 404s, no dupes, no parameter'd URLs, no canonicalized, etc..
Are they duplicates in the sense that one has caps, and the other doesn't? As in /example.html and /Example.html. If so, you'll want to fix that.
If they're identically formatted URLs, there should be no problem, but you're at duplicate content risk if they're different in anyway and not canonicalized.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL Keyword Variations?
I'm aware that keywords in the url aren't as effective as they used to be, but I'm still convinced that they do have a significant impact (based on results in one of the niches I'm in). My question is, will variations of keywords and "hidden" keywords have as much value as an exact keyword? For example, let's say that I'm trying to target the keyword "day." Will including variations like "daily" in the url work just as well? What about a brand name that includes the keyword hidden in its name, like "Dayest"? And, as a followup question, does including "stop" words have any effect? For example, if I'm trying to target the keyword "Day of the Month", would including "day" and "month" in the url be just as effective as including "day of the month"?
On-Page Optimization | | JABacchetta0 -
Google Places Problem
This may have been answered before but I have 2 questions. When I placed a business in Google Places, the "generic" ranking fell off the map. I now just have the 1 line Google places reference and that is all I can find. How can I get around that and get my 4 line description to show again? Do I have to delete my Places account? Before the Google Places account was built, the company was moving up the SERP ranks, now he is on pg 1 for Places but the other SERP positions have disappeared. This is true for all the keywords we are targeting. If there is not a Places reference he shows on Pg 3-5 (given the website is 4 weeks old, I think this is not bad). For the same client, he that services many of the surrounding communities. How do I get Google to recognize the various towns he services during a search? He places well for his "home" town but not at all for the other towns. if it helps any, the website is www.myairstat.com. Thanks for the help. Scott
On-Page Optimization | | scott5180 -
Can Sitemap Be Used to Manage Canonical URLs?
We have a duplicate content challenge that likely has contributed to us loosing SERPs especially for generic keywords such as "audiobook," "audiobooks," "audio book," and "audio books." Our duplicate content is on two levels. 1. The first level is at our web store, www.audiobooksonline.com. Audiobooks are sometimes published in abridged, unabridged, on compact discs, on MP3 CD by the same publisher. In this case we use the publisher description of the story for each "flavor" = duplicate content. Can we use our sitemap to identify only one "flavor" so that a spider doesn't index the others? 2. The second level is that most online merchants of the same publisher's audio book use the same description of the story = lots of duplicate content on the Web. In that we have 11,000+ audio book titles offered at our Web store, I expect Google sees us as having lots of duplicated (on the Web) content and devalues our site. Some of our competitors who rank very high for our generic keywords use the same publisher's description. Any suggestions on how we could make our individual audio book title pages unique will be greatly appreciated.
On-Page Optimization | | lbohen0 -
Problem with Occurrences of Keyword
At "On-Page Report " i have noticed that the only important problem my site has is the "Occurrences of Keyword " it says that i have ONLY 14.156 keyword repeat. My page ofcourse does not have so many repeats of same keyword. In fact this keyword is shown 10 times as i saw at source code of this page i tested. This report is for one page or for all pages of domain ? My keyword was two words keyword if that matters but there is no way that keywords to be repeated so many times.
On-Page Optimization | | Web-Builders0 -
Recommendation: Add a canonical URL tag referencing this URL to the header of the page.
Please clarify: In the page optimization tool, seomoz recommends using the canonical url tag on the unique page itself. Is it the same canonical url tag used when want juice to go to the original page? Although the canonical URL tag is generally thought of as a way to solve duplicate content problems, it can be extremely wise to use it on every (unique) page of a site to help prevent any query strings, session IDs, scraped versions, licensing deals or future developments to potentially create a secondary version and pull link juice or other metrics away from the original. We believe the canonical URL tag is a best practice to help prevent future problems, even if nothing is specifically duplicate/problematic today. Please give example.
On-Page Optimization | | AllIsWell0 -
Should I buy an established domain that has lost it's high PR due to being offline for several months?
I'm considering purchasing a domain that has sat idle for several months. It was a company's domain that they have owned since the mid1990's but they went out of business. Previously, it had a PR 5 but has since lost it's PR as it has sat 'inactive' with a 'server not found' warning for the past several months. That being said, is there any point in buying the domain (for SEO purposes)? Is there any recourse with Google to try and re-establish the site's credibility or would I be starting over from scratch?
On-Page Optimization | | martybuch230 -
Is this duplicate content okay?
We have a client who wants to rank locally, nationally and internationally for their products. I wrote a line that goes, "We can ship our products to you whether you’re here in Illinois, nationwide, or international." I added that line after a paragraph or two of unique product description on each of their 30-odd product pages. Will this damage their ranking? I tried researching this but only found full page duplicate content topics. Any advice would be great.
On-Page Optimization | | optimalwebinc0 -
Duplicate content on my domain
I have several pages on my domain that are using the same content except for changing a paragraph or sentence. Do I need to create unique content, even though much of the information pertains to a feature and is related?
On-Page Optimization | | Court_H0