Duplicate page errors
-
I have 102 duplicate page title errors and 64 duplicate page content errors. They are almost all from the email a friend forms that are on each product of my online store. I looked and the pages are identical except for the product name. Is this a real problem and if so is there a work around or should I see if I can turn off the email a friend option? Thanks for any information you can give me.
Cingin Gifts
-
Thanks for the good advice everyone. I really appreciate it.
Keith
-
Odds are that this isn't causing you major problems yet, but if the variants are indexed by Google (you can check with the "site:" operator), I would use the META robots tag. Robots.txt is good for prevention, but it's not great at clearing pages out of the index, in my experience.
-
The change you made to the robots should be sufficient. You can also add the meta tag in there to be doubly sure, but its not needed
Though, your social buttons has the Email A Friend option built in so you are replicating the same functionality with the Email a Friend button.
No problem, happy to help.
Aran
- if your problem is solved, dont forget the Answered, and Good answer buttons
-
Hi Aran,
I added that line to my robots.txt file.
User-agent:*
Disallow: /cgi-bin/
Disallow: /v/vspfiles/photos/
Disallow: /EmailaFriend.aspSomeone else recommended adding the following line to the EmailAFriend.asp file. Do I need this line?
I like the suggestion for removing the email a friend and working more on the social area. I thought turning off the email part was probably the easiest fix for the duplicate pages.
Thanks for the great advice!
Keith
-
Looking at your site I see that your Email a friend script is opening a brand new page and passing through the product ID. To stop the page being indexed you can add the following line to the robots.txt
Disallow: /EmailaFriend.asp
afte the line that looks something like
User-Agent: *
Heres some light reading on the robots.txt file
http://www.seomoz.org/learn-seo/robotstxt
BE CAUTIOUS! if you dont know what your doing seek further assistance as you could do some bad things in the robots.txt.
Whilst the solution above will probably solve your duplicate page issue. I think there is room for improvement here.
Email a friend scripts needn't take the user away from the product they are viewing. You could open the email a friend script in a new window, or even better get rid of the Email a friend button altogether and make your social sharing buttons bigger and more prominent. Also, consider giving the users a Call to Action to sharing the product via the social buttons.
Hope this helps.
Aran
-
Hi Steven, I just got that report from seomoz and those errors were returned from their crawling of the site. I'm new to this SEO stuff so I'm not sure about the indexing thing. I do know a little about the robots.txt file so I'll look into blocking those pages.
Thanks,
Keith
-
Do they need to be indexed? Perhaps you should consider using blocking any spider from crawling them using robots and using a noindex meta tag.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Is The Number of Duplicate Pages reduced after adding canonical ref to the dupe versions ?
Hi Is the number of duplicate pages reported in a dupe page content error report reduced on subsequent crawls, if you have resolved the dupe content problem via adding the canonical tag to duplicate versions (referring the original page). Like it would if you were solving the problem via a 301 redirect (i think/presume) ? Cheers Dan
Moz Pro | | Dan-Lawrence0 -
How can I remove on-page reports from the Summary page?
Hi, I'd like to remove some on-page reports from the Summary page. I've already stopped them from running weekly. Is there a way to remove them completely?
Moz Pro | | csmm0 -
Duplicate Errors found in my search
I have run my 1st site check with SEOMOZ and have 4000+ errors. The "duplicate Page Content" culprit appears to be a extended url that keeps showing as duplicating. This is only a customer log-in and can be redirected back to the main cust log in page, but is there a short way of doing it (rather than 4000x 301's)? The format of the url is: http://www.????.com.au/default/customer/account/login/referer/aSR0cDovL3d3dy1234YWNiYW Thanks
Moz Pro | | Paul_MC0 -
Domain / Page Authority - logarithmic
SEOmoz says their Domain / Page Authority is logarithmic, meaning that lower rankings are easier to get, higher rankings harder to get. Makes sense. But does anyone know what logarithmic equation they use? I'm using the domain and page authority as one metric in amongst other metrics in my keyword analysis. I can't have some metrics linear, others exponential and the SEOmoz one logarithmic.
Moz Pro | | eatyourveggies0 -
How to trace 4XX errors in campaign data?
I am trying to resolve a number of 4XX (Client Error) issues noted in my campaign report, but I have no idea where they are originating. All I get is the broken link, the status code, the page authority and the number of linking root domains. How do I identify where the erroring link originates? Is it coming from within my website, or from an external website? I have gone through my site in great detail looking for these links, but can't find any evidence of them. I also use a broken link detection plugin and it reports no problems whatsoever. Is there a way I can drill down into these 404 links and get more detail about where they are coming from?
Moz Pro | | WebSupportGuy420 -
Crawl Errors Confusing Me
The SEOMoz crawl tool is telling me that I have a slew of crawl errors on the blog of one domain. All are related to the MSNbot. And related to trackbacks (which we do want to block, right?) and attachments (makes sense to block those, too) ... any idea why these are crawl issues with MSNbot and not Google? My robots.txt is here: http://www.wevegotthekeys.com/robots.txt. Thanks, MJ
Moz Pro | | mjtaylor0 -
Crawling One Page
I set up a profile for a site with many pages, opting for setting up as a root directory. When SEOMoz crawled, they only found one page. Any ideas for why this would be? Thanks!
Moz Pro | | Group160 -
Duplicate page error from SEOmoz
SEOmoz's Crawl Diagnostics is complaining about a duplicate page error. I'm trying to use a rel=canonical but maybe I'm not doing it right. This page is the original, definitive version of the content: https://www.borntosell.com/covered-call-newsletter/sent-2011-10-01 This page is an alias that points to it (each month the alias is changed to point to the then current issue): https://www.borntosell.com/covered-call-newsletter/latest-issue The alias page above contains this tag (which is also updated each month when a new issue comes out) in the section: Is that not correct? Is the https (vs http) messing something up? Thanks!
Moz Pro | | scanlin0