Our Duplicate Content Crawled by SEOMoz Roger, but Not in Google Webmaster Tools
-
Hi Guys,
We're new here and I couldn't find the answer to my question. Here it goes:
We had SEOMoz's Roger Crawl all of our pages and he came up with quite a few erros (Duplicate Content, Duplicate Page Titles, Long URL's).
Per our CTO and using our Google Webmaster Tools, we informed Google not to index those Duplicate Content Pages. For our Long URL Errors, they are redirected to SEF URL's.
What we would like to know is if Roger is able to know that we have instructed Google to not index these pages. My concern is
-
Should we still be concerned if Roger is still crawling those pages and the errors are not showing up in our Webmaster Tools
-
Is there a way we can let Roger know so they don't come up as errors in our SEOMoz Tools?
Thanks so much,
e
-
-
Thanks Kent!
-
In order to answer your questions, we need to understand exactly how you "instructed Google".
If you went into Google Webmaster Tools and changed settings such as parameters of URLs, then only Google will know about those changes. Roger wont know and neither will Bing or any other crawler.
Whenever possible I recommend making the proper adjustments on your site so all crawlers know and understand how to crawl your website.
**1) Should we still be concerned if Roger is still crawling those pages and the errors are not showing up in our Webmaster Tools **
Yes. First of all, Bing + Yahoo = 30% of the search market and they will experience the same trouble as Roger. Second, by informing Google directly you are making changes in a way that make it impossible for tools such as Roger to provide you with actionable data.
2) Is there a way we can let Roger know so they don't come up as errors in our SEOMoz Tools?
Not that I am aware of. I wish Roger made better friends with Googlebot and could learn all the personal settings, but that was not possible the last time I checked.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How to Avoid Duplicate Page Content errors when using Wordpress Categories & Tags?
I get a lot of duplicate page errors on my crawl diagnostics reports from 'categories' and 'tags' on my wordpress sites. The post is 1x link and then the content is 'duplicated' on the 'category' or 'tag' that is added to the page. Should I exclude the tags and categories from my sitemap or are these issues not that important? Thanks for your help Stacey
Moz Pro | | skehoe1 -
To Worry or Not? Duplicate Content Created from Redirect After Login
One of my Moz reports is flagging duplicate content. For example, https://redchairmarket.com/Account/LogOn?ReturnUrl=%2FAccount%2FSaveSearch%3FsearchId%3D0&searchId=0 and https://redchairmarket.com/Account/LogOn?ReturnUrl=%2FAccount%2FSaveSearch%3FsearchId%3D1&searchId=1 are created when a user logs in and the website sends them back to the page they were looking at before. What is the best way to deal with this duplicate issue? How serious is it? Thank you!
Moz Pro | | BrittanyHighland0 -
Does SEOmoz tool provide me the option to track rankings for other search engines like google.co.uk?
I need to track rankings on search engines across different geographies. Does your tool provide the option to track rankings for search engines other than the ones used in US
Moz Pro | | zycus0 -
Functionality of SEOmoz crawl page reports
I am trying to find a way to ask SEOmoz staff to answer this question because I think it is a functionality question so I checked SEOmoz pro resources. I also have had no responses in the Forum too it either. So here it is again. Thanks much for your consideration! Is it possible to configure the SEOMoz Rogerbot error-finding bot (that make the crawl diagnostic reports) to obey the instructions in the individual page headers and http://client.com/robots.txt file? For example, there is a page at http://truthbook.com/quotes/index.cfm month=5&day=14&year=2007 that has – in the header -
Moz Pro | | jimmyzig
<meta name="robots" content="noindex"> </meta name="robots" content="noindex"> This page is themed Quote of the Day page and is duplicated twice intentionally at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2004 and also at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2010 but they all have <meta name="robots" content="noindex"> in them. So Google should not see them as duplicates right. Google does not in Webmaster Tools.</meta name="robots" content="noindex"> So it should not be counted 3 times? But it seems to be? How do we gen a report of the actual pages shown in the report as dups so we can check? We do not believe Google sees it as a duplicate page but Roger appears too. Similarly, one can use http://truthbook.com/contemplative_prayer/ , here also the http://truthbook.com/robots.txt tells Google to stay clear. Yet we are showing thousands of dup. page content errors when Google Webmaster tools as shown only a few hundred configured as described. Anyone? Jim0 -
How to solve duplicate page title & content error
I got lot of errors in Duplicate page title - 5000 Here the result page is same and content is also same,but it differs only with page no in meta title Title missing error In seomoz report i got empty msg - title,meta desc,meta robots,meta refresh But if i check the link which i got error it shows all meta tags..we have added all meta tags in our site..But i dont no why i got title missing error . 404 error In this report,if i click the link which i got error, it goes to main page of our site. But the url differs. eg: The error link is :www.example.com/buy/requirement-2-0-inmumbai-property it automatically goes to www.example.com page Let me know how to solve these issues.
Moz Pro | | Rajesh.Chandran0 -
"Issue: Duplicate Page Content " in Crawl Diagnostics - but sample pages are not related to page indicated with duplicate content
In the crawl diagnostics for my campaign, the duplicate content warnings have been increasing, but when I look at the sample pages that SEOMoz says have duplicate content, they are completely different pages from the page identified. They have different Titles, Meta Descriptions and HTML content and often are different types of pages, i.e. product page appearing as having duplicate content vs. a category page. Anyone know what could be causing this?
Moz Pro | | EBCeller0 -
Seomoz logging in
Hey, The seomoz toolbar was permenantly logged in. But for some reason after a period of inactivity it now logs out and I have to relogin. I'm using firefox, what could be causing this?
Moz Pro | | PeterM220 -
FB Shares in SEOmoz Keyword Analysis Tool
Hello everybody, I'm quite confused in how to understand "FB Shares" in SEOmoz Keyword Analysis Tool Report. As You may know, this section is under report's "Social Signals" category. Does this number counts whole FB shares of some website links by ALL FB users? Or is it a number of some website FB account posts? Some clearance would be very helpful.. The same question applies to other social signal reports: Tweets, Google+ shares. Thank You for your answer! Happy New Year!
Moz Pro | | jkundrotas0