Moz shows duplicate content, but URL's are tagged with campaign tags
-
Crawl diagnostics shows a lot of pages with duplicate content, but when I check the details, I see that it lists the same page but the url contains a campaign tag, so it's not really another page that is serving identical content...
Is there a way to remove these pages out of the Crawl Diagnostics?
-
Hey Joris,
I'm afraid that we aren't able to see what parameters you are adding to GWT, since we don't use that information in any way to crawl your site. We conduct a proprietary crawl of the site and report on exactly what your source code and server respond with.
Patrick is right that adding the canonical tags to your site (or using the robots.txt file to block the campaign pages) would clear up those errors in our crawler.
Since some dynamic URL generators can cause problems for crawlers, we do try to be overly-inclusive of these issues. We want people to know about potential issues with sites, even if they're not really issues in the scheme of the site owner's specific SEO implementation plan. In sum, we'd rather leave those judgments up to you. I hope this helps explain our thinking here!
-
Hi there
Well the canonical tag would help Moz understand that this page isn't duplicate, that's why I mentioned that tactic.
As far as Search Console, I was just trying to help get you other angles covered.
I would try canonical tags and see how that goes over on your next report.
Hope this helps! Good luck!
-
Thanks,
I already added the URL parameters in GWT but it's the duplicate content that is appearing in my MOZ reports because of those tags.
No way to exclude them of MOZ? Imagine you have a page that and a lot of tagged links pointing towards that page, it's gonna list all those tagged links in the duplicate content report.
-
Hi there
Campaign tags don't signal unique content. It's essentially the same concept as...
http://www.example.com
http://example.comBoth are two different URLs but have the same content, thus making it duplicate content, even though it's technically the same page.
What you can do is take a look into your canonical tags and make sure those are upto date and correct. You can also look into categorizing your parameters, letting crawlers know how to handle this content. Both of these resources will help with your duplicate content issue.
Yoast has a great resource as well for common causes and solutions to duplicate content.
Hope this helps! Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Tags on my website cause duplicate content
Hi I just recently started a website and I am new to MOZ pro. What Moz pro detected on my website under high priority is that "duplicate page content" and what I realize about these duplicate page content is regarding the tags i put on my post. Because it is a wordpress blog, we are allow to add tags on the side before we publish our post. And because of these tags, it linked to the same page but different url. for example website.com/tags/whatever website.com/tags/whatever 2 and both these url direct to the same page So how do i solve this? do i just stop tagging whenever i write a post? delete all tags while it is not necessary? i seen method like 301 redirect or rel=canonical but is there anyway to solve this problem so I do not face this issue whenever i make a new post in my blog? I mean it doesnt make sense to redirect 301 to every single tags i have whenever i write a new post right? thanks guys
Moz Pro | | andzon0 -
Why can't I see last week's stats?
Can see stats week ending May 1st but nothing after that- and it's May 9th!?
Moz Pro | | locumhunter0 -
Moz Local
Hey Does anyone know when Moz Local will be available in the UK? Please share your experience. I'd like to know how it's actually helped your business and client base. Thanks so much Gary
Moz Pro | | GaryVictory0 -
Rogerbot crawls my site and causes error as it uses urls that don't exist
Whenever the rogerbot comes back to my site for a crawl it seems to want to crawl urls that dont exist and thus causes errors to be reported... Example:- The correct url is as follows: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/ But it seems to want to crawl the following: /vw-baywindow/cab_door_slide_door_tailgate_engine_lid_parts/cab_door_seals/genuine_vw_brazil_cab_door_rubber_68-79_10330/?id=10330 This format doesn't exist anywhere and never has so I have no idea where its getting this url format from The user agent details I get are as follows: IP ADDRESS: 107.22.107.114
Moz Pro | | spiralsites
USER AGENT: rogerbot/1.0 (http://moz.com/help/pro/what-is-rogerbot-, rogerbot-crawler+pr1-crawler-17@moz.com)0 -
Moz campaign works around my robots.txt settings
My robots.txt file looks like this: User-agent: * Disallow: /*? Disallow: /search So, it should block (deindex) all dynamic URLs. If I check this url in Google: site:http://www.webdesign.org/search/page-1.html?author=47 Google tells me: A description for this result is not available because of this site's robots.txt – learn more. So far so good. Now, I ran a Moz SEO campaign and I got a bunch of duplicate page content errors. One of the links is this one: http://www.webdesign.org/search/page-1.html?author=47 (the same I tested in Google and it told me that the page is blocked by robots.txt which I want) So, it makes me think that Moz campaigns check files regardless of what robots.txt say? It’s my understanding User-agent: * should forbid Rogerbot from crawling as well. Am I missing something?
Moz Pro | | VinceWicks0 -
Re : Duplicate Content
Hello, I am a pro member, in my campaign it says duplicate content for few urls. which i m not able to understand, because both the url's are same but why its showing under duplicate content. here are the urls example. http://www.giftbig.com/helios-gift-card.html http://www.giftbig.com/helios-gift-card.html/
Moz Pro | | dasjoy850 -
Why do some of my sites stop showing up as ranking on SEO Moz (listed as not in top 50) when in google ranks they are top five?
Okay - so i have several campaigns. And of these campaigns, about four or five of them no longer show up as ranking after several weekly crawls by SEOMoz... Not sure why the line on the chart just stops when they are ranking in top 5 for google organics am confused by this can you help me do what i need to do so that the seobot can read my pages and save me time on checking where i rank - thanks Creative Guy
Moz Pro | | creativeguy0 -
Broken Links and Duplicate Content Errors?
Hello everybody, I’m new to SEOmoz and I have a few quick questions regarding my error reports: In the past, I have used IIS as a tool to uncover broken links and it has revealed a large amount of varying types of "broken links" on our sites. For example, some of them were links on my site that went to external sites that were no longer available, others were missing images in my CSS and JS files. According to my campaign in SEOmoz, however, my site has zero broken links (4XX). Can anyone tell me why the IIS errors don’t show up in my SEOmoz report, and which of these two reports I should really be concerned about (for SEO purposes)? 2. Also in the "errors" section, I have many duplicate page titles and duplicate page content errors. Many of these "duplicate" content reports are actually showing the same page more than once. For example, the report says that "http://www.cylc.org/" has the same content as "http://www.cylc.org/index.cfm" and that, of course, is because they are the same page. What is the best practice for handling these duplicate errors--can anyone recommend an easy fix for this?
Moz Pro | | EnvisionEMI0