SEOmoz suddenly reporting duplicate content with no changes???
-
I am told the crawler has been updated and wanted to know if anyone else is seeing the same thing I am.
SEOmoz reports show many months of no duplicate content problems. As of last week though, I get a little over a thousand pages reported as dupe content errors.
Checking these pages I find there is similar content (hasn't changed) with keywords that are definitely different. Many of these pages rank well in Google, but SEOmoz is calling them out as duplicate content. Is SEOmoz attempting to closely imitate Google's perspective in this matter and therefore telling me that I need to seriously change the similar content?
Anyone else seeing something like this?
-
Hi
We see the extreme raise in the duplicate content of our site too. If the sensitivity is adapted, will these graphs come down again?
What is your opinion on how Google sees a webshop with lot's of products and filter options? Our site www.dmlights.com/massive for example can have a lot of filtering but we try to counter this in Webmaster Tools with the URL parameters.
Do you suggest to adapt this for good seo?
Wondering about your opinions. Thanks.
-
Hey Scott,
Again, we're sorry about the odd jump in duplicate content errors!
We just launched a new crawler and it is being extremely sensitive to duplicate content. As of now we are picking up duplicate pages on your domain via:
https clones of URLs
Some pages have a “/” trailing after the URL and some don’t
We are also ignoring some rel=canonical directives
This is an issue that other users are seeing with their crawls. Our engineers have made some changes to the crawler to scale back the sensitivity to these issues on the crawler and you should be seeing the changes within a week or two.
We're really sorry for the confusion.
Best of Luck,
Chiaryn
-
Two good suggestions so far, and both I had checked. Thanks KJ Rogers and Ryan Kent.
This is starting to look like it boils down to how much the new SEOmoz crawler sees content in the same way that Google does.
We did not make any site-wide changes and the URLs identified as duplicate in the report are valid URLs that actually hold similar content (keywords and so forth were changed for each version of a slightly different product through an Excel Concatenate construct to build the content). We have actually seen these pages climb in rank over the months since the content was added.
So, like I said, the sudden identification of these as duplicate by the moz crawler is suspicious to me. Not sure it sees things the way Google does.
-
Without examining your site and the pages involved it is not possible for me to share feedback.
Is it possible you made any recent site wide changes? Changes to your header, navigation, footer or sidebar could have pushed you passed a certain threshhold of duplicate content which triggered a flag.
-
I got the same thing last week. I later found out that mine, using dynamic content on the same page, had speical characters in the url which was taking crawlers to an error page. The error page was showing a list of pages with the url's capitalized. I was able to fix some of them, but it scared the heck out of me.
I had to run a crawl test from SEOMoz to filter out what was going on. Perhaps you have something similar?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Sudden increase in backlinks with "Link Reclamation": Any risk from Google?
Hi all, We failed to redirect the links of our old website versions to new website pages for years and we are planning to now redirect all those old links to new in the process of link reclamation. This activity may increase the back links suddenly or steadily. If there is sudden increase in backlinks, will it hurts us? What's Google's stand? Thanks
Algorithm Updates | | vtmoz1 -
Site has disappeared since Panda 4 despite quality content, help!
Our site www.physicalwellbeing.co.uk has lost over 20 first page rankings since the end of May. I assume this is because of Panda 4.0. All content on the site is high quality and 100% unique, so we did not expect to get penalised. Although I read somewhere that if Google can't read particular js anymore they don't rank you as high. The site has not been blacklisted as all pages are showing in Google's index and there are no messages on webmaster tools. We have not taken part in any link schemes and have disavowed all low quality links that were pointing there just in case (after the penalty). Can anybody see anything on www.physicalwellbeing.co.uk that may have cause Panda update to affect it so negatively? Would really appreciate any help.
Algorithm Updates | | search_shop0 -
Google Algorithm change this month - theories ?
Hi Moz fans! If you've not had the chance to check out moz cast go check it out it seems Google has been busy and so much so it broke Moz cast. There has been some discussion on seo round table about the changes and something seems to be going on. I wanted to find out how you guys are all finding it have you had a change in rankings? Any theories on what you think Google is up to? Personally I've seen rather a few of my sites go up in the rankings last week or so. As always look forward to hearing your thoughts and feelings on it Moz.
Algorithm Updates | | GPainter3 -
Website traffic dropped 50% after 14th November same day GWT reported a DNS error
HI there. On 14th November GWT reported a DNS error on my site I checked with my hosts but they said there was nothing wrong. I then went searching for answers and found it happened to lot of people on that specific day see http://moz.com/blog/was-there-a-november-14th-google-update. After that time my website traffic dropped by 50% over the period of a week and is still sitting on 50% of what it was. I then moved the site to VPS, had a few DNS errors - that were the cause of my hosts - so i moved back to shared hosting last weekend and now DNS issues are solved. However the original DNS issue is still unknown I dont know what went wrong and want to rectify issue. I dont sell ads and write original content 4 times a day. I have a miniscule bounce rate, my site speed is okay and i dont stuff keywords in my content although i was careless with my <alt tags="">so they could be considered keyword stuffing (and i have up to 10 images on one post). But i have been removing all the keywords in my images theres over 3000 posts so its taking time). My impressions have dropped from 10,000 a day to 2,500 and I have no idea why.</alt> My website has been building traffic consistently for the last 2 years. Only now has it crashed a bit. Have you any advice on what I can do to solve this problem or rather find the cause of the issue. Im not a pro seo person and do this blog in my free time so am not an expert on data analyzing etc.... thanks alot
Algorithm Updates | | mutant20080 -
Frequency & Percentage of Content Change to get Google to Cache Every Day?
What is the frequency at which your homepage (for example) would have to update and what percentage of the page's content would need to be updated to get cached every day? What are your opinions on other factors.
Algorithm Updates | | bozzie3110 -
Yahoo & Bing algorithm changes?
We have noticed that several of our clients have been falling fairly significantly in the rankings in both Yahoo and Bing in recent weeks. Do you know if they have made any algorithm changes lately, and if so, do you have any indication of what changes may have been made?
Algorithm Updates | | GregWalt0 -
Need help with some duplicate content.
I have some duplicate content issues on my blog I'm trying to fix. I've read lots of different opinions online about the best way to correct it, but they all contradict each other. I was hoping I could ask this community and see what the consensus was. It looks like my category and page numbers are showing duplicate content. For instance when I run the report I see things like this: http://noahsdad.com/resources/ http://noahsdad.com/resources/page/2/ http://noahsdad.com/therapy/page/2/ I'm assuming that is just the categories that are being duplicated, since the page numbers only show on the report at the end of a category. What is the best way to correct this? I don't use tags at all on my blog, using categories instead. I also use the Yoast SEO plug in. I have a check mark in the box that disables tags. However it says, "If you're using categories as your only way of structure on your site, you would probably be better off when you prevent your tags from being indexed." There is a box that allows you to disable categories also, but the description above makes it seem like I don't want to block both tags and categories. Any ideas what I should do? Thanks.
Algorithm Updates | | NoahsDad0 -
Duplicate videos
We have multiple screen cast videos being made that are the same all except for city names being switched out. Does anyone know if this might be frowned upon by Google in the same way that duplicate content is?
Algorithm Updates | | Stevej240