Need help fixing the duplicate content that keeps growing
-
Need help fixing the duplicate content that keeps growing
-
can you do me a favour and check if http://www.............magazine.com is duplicate with the above domain that we are talking about i used your similar page checker and it said 100% we have a redirect on the domain, but i am concerned that it may not be effective
-
Thank you for your help, So these pages have no content on them yet, So I guess I need to put some content on them. Do you think that these issues affect my google ranking?
T
-
Hey T,
I want to let you know that I removed the link to your campaign from your last post and I would recommend that you don't post those types of links publicly. Our site is secure, and only admins and account owners can access data through those links, but you never know what someone may try to do maliciously with that information.
For the link you provided, we are reporting those pages as duplicate content because they are pretty much 100% similar in the code and content for the page: http://www.screencast.com/t/qMgveoj4i. (Our campaign tolerance is 90% similarity.) The only difference is the state name the pages refer to, which is not enough to make the pages different. You can verify that using this tool here: http://smallseotools.com/similar-page-checker/
Here is a great resource for learning about canonical tags: https://moz.com/learn/seo/canonicalization
Here is a post about how we detect duplicate content:https://moz.com/devblog/near-duplicate-detection/ And for more information on using canonical tags, check out this great post by our very own Dr. Pete: http://moz.com/blog/rel-confused-answers-to-your-rel-canonical-questions -
Hi Chiaryn, and Bryan
thanks for your help..I did not want to be too specific initially as I did not know how open this help request would be.The site is as mentioned above.
One question, will all these duplicate content affect the site in Google?
I can apply the User-agent: *
Disallow: ?attachmentWhat is the code to perform the canonical tag?Also please can you look at this duplicate content.. I do t understand why it is duplicate content
If I fix these issues will my site ranking improve?
Thanks again
T
-
Hey There! It looks like you are trying get some assistance without specifically naming the site you are concerned about and I definitely understand that, but it is really difficult to give advice on this issue without more detailed information. However, I took a look at your campaigns and I am going to address the issue I am seeing with the site that had the largest increase of duplicate content over the last couple of crawls. I apologize if this isn't the site you are referring to.
The campaign I'm looking at is the 5 Star campaign. It looks like a large number of the pages with duplicate content are related to ?attachment parameters in the URL, such as www.site.com/?attachment_id=77899. There is very little content on these pages and it looks like they are added to the site pretty regularly, since all of the ones I looked at are dated closely together.
I'm not an SEO expert, so Bryan may have better advice for you, but I can give a few suggestion of how to resolve this issue. I don't entirely understand the purpose of these pages, so that would affect which of these options might be best for your personal strategy for the site.
You can add a canonical tag to these pages to point to one specific page as the most important page with this content. For this option, they would have to point back to the same page or our crawler will still show them as duplicates because we assume that the two canonical pages are then also likely to be duplicates. Google, however will stop indexing these pages.
You can also block these pages from being accessed using the robots.txt file for this site. For example, it would look something like this:
User-agent: *
Disallow: ?attachmentetc., until you have covered all of the parameters you would like to block. The User-agent: * blocks all crawlers from accessing those pages, but you can also use User-agent: rogerbot to specifically block only our crawler.
I hope this helps! Please let me know if I can help you with anything else.
-
That's still not quite enough to go on. Could you provide the message they're giving you, and/or URLs regarding the duplicate content? Examples in either should prove helpful.
-
Hi thanks for the heads up.. just been very frustrating.
Moz and Google show dup internal content.
Using WordPress and Yoest SEO plugin to try to fix some of the issues.
Blog content
Regards T
-
You'll have to be a lot more specific. Try answering at least some of these questions so we can help you:
- What content is being duplicated?
- Where are the duplicates?
- Is this all internal (on your site only)?
- Are you receiving any duplicate content warnings from Moz, Google, etc.?
- In what way does it "keep[s] growing?"
- What kind of content is this?
Once you provide answers to some of these questions, I'm sure we'll be able to help you fix the issue.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to rank website on google with help of Moz ?
I am new here and my question is how rank a website with moz because my website was not ranking in any keywords so plz guide me
Getting Started | | RoyDigitalWorld0 -
Moz only crawling one page of a campaign, please help
Today I set up a new campaign for a client, however the crawl has only found the home page and is saying that the URL is unavailable. The site is definitely live and the URL is correct. I have set up the campaign 3 times one with the full address (http://www.) one with www. and with just the domain name. All three of these have come page with one page crawled and "unavailable" above the URL. It is picking up the crawl issues on the page and showing domain authority but I don't know why it's not crawling other pages. Prior to setting up the campaign I did a site crawl and Moz found everything then, so I don't know why it isn't now. Please help. Thanks
Getting Started | | Wrapped0 -
My website does not allow all crawler to crawl, Now my question is that whether i need to give permission to moz crawler if yes then whaat is moz bot name?
My website does not permit all crawler to crawl website. Whether ii need to give permission to moz bot to crawl website or not? If yes what is the moz bot name?
Getting Started | | irteam0 -
How to locate page with the duplicate title? (Crawl Diagnostics - Duplicate Titles Warning)
I am looking through my crawl diagnostics and one of my errors states that a page has a duplicate title. My problem is that I do not know how to find the duplicate. Any advice here?
Getting Started | | bearpaw0 -
Can I upgrade my moz subscription from large to premium without getting my campaigns being deleted?Do i need to wait till the end of the month to resubscribe?
I'm planning to take a large subscription of moz..but i may need a premium account in the future.Can I upgrade it in the middle of my current subscription or will i have to wait till my subscription gets over? Also, I'm planning to take only one month currently but i'll renew it once the month completes so can i continue the same account without my campaigns being deleted?
Getting Started | | kdcdmp0 -
Moz's official stance on Subdomain vs Subfolder - does it need updating?
Hi, I am drawing your attention to Moz's Domain basics here: http://moz.com/learn/seo/domain It reads: "Since search engines keep different metrics for domains than they do subdomains, it is recommended that webmasters place link-worthy content like blogs in subfolders rather than subdomains. (i.e. www.example.com/blog/ rather than blog.example.com) The notable exceptions to this are language-specific websites. (i.e., en.example.com for the English version of the website)." I am wondering if this is still Moz's current recommendation on the subfolders vs subdomains debate, given that the above (sort of) implies that SE's may not combine ranking factors to the domain as a whole if subdomains are used - which (sort of) contradicts Matt Cutts last video on the matter ( http://www.youtube.com/watch?v=_MswMYk05tk ) which implies that this is not the case and there is so little difference that their recommendation is to use whatever is easiest. It would also seem to me that if you were looking through the eyes of Google, it would be silly to treat them differently if there were no difference at all other than subdomain vs subfolder as one of the main reasons a user would use a sud-domain is a technical on for which it would not make sense for Google to treat differently in terms of its algorithm. I notice that in terms of Moz, while most of the site uses subfolders, you do have http://devblog.moz.com/ - and I was wondering if this is due to a technical reason or conscious decision, as it would seem to me that the content within this section is indeed linkworthy (as it has external links pointing to it from external sources), therefore it would seem to not be following the initial advice that is posted in Moz's basics on domains. Therefore I am assuming it is due to a technical reason - or that Moz's adive is out of date with current Moz thinking, and is indeed in line with Matt C in that it doesn't matter. Cheers
Getting Started | | James773 -
Need to Add Moz code?
Do i need to add tracking code in my website, for Moz tool to analyze my website. Please someone let me know.
Getting Started | | TOBOC0 -
Does Moz Analytics need Google Analytics installed?
I have a few websites on my Moz Analytics account but only have data for one of them. All my other accounts keepy saying come back in 24hrs for more data, although there is no data available. Do I need to connect each account with Google Analytics before Moz populates its own analytics?
Getting Started | | david.smith.segarra1