Since July 1, we've had a HUGE jump in errors on our weekly crawl. We don't think anything has changed on our website. Has MOZ changed something that would account for a large leap in duplicate content and duplicate title errors?
-
Our error report went from 1,900 to 18,000 in one swoop, starting right around the first of July. The errors are duplicate content and duplicate title, as if it does not see our 301 redirects. Any insights?
-
Thank you, Lynn. Our duplicate content generally comes from a subdomain we are trying to eliminate: commercial.vigilantinc.com, which is redirected to vigilantinc.com/commercial, and from our online shop, shop.vigilantinc.com. Our redirects are server-side, so this morning we updated the htaccess file so include the redirects. Our crawl doesn't happen for a few days, but we will see if that solves the problem. (We have always included the Rewrite rule to eliminate the www in our htaccess file.)
Thanks so much for your response!
-
Hi Kristy,
I don't think anything has changed with the crawler so a good idea to look deeper to see if anything has changed with the site. You mention 301s, so are you seeing a lot of www vs non www duplicates? Tell us the site so we can have a better look but it is the one in your profile then I can see that the content is available on both www and non www versions so maybe something has changed in your htaccess file and caused your 301 redirects to fail.
Hope that helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why can't I see last week's stats?
Can see stats week ending May 1st but nothing after that- and it's May 9th!?
Moz Pro | | locumhunter0 -
Is it possible to block Moz from crawling sites?
Hi, is it possible to stop Moz from crawling a site at the server level? Not that I am looking to do this or anything, but here's why I'm asking. I have been crawling a site that is managed (currently by 2 parties), and I noticed that this week pages crawled went from 80 (last week) to 1 page!! I know, what? See my image attached... and the issues all went to zero "0"....! So is it possible that someone can't prevent Moz from crawling the site at the server level? I checked the robots.txt file on the site, but nothing there. I'm curious. dYNUwjd.jpg
Moz Pro | | co.mc0 -
Moz Website Grader Export Omits Check Graphics
So, I love the Grader, but when I export to PDF the pretty little graphics go away. Is this correctable?
Moz Pro | | ClickMonsterIM0 -
Help with URL parameters in the SEOmoz crawl diagnostics Error report
The crawl diagnostics error report is showing tons of duplicate page titles for my pages that have filtering parameters. These parameters are blocked inside Google and Bing webmaster tools. I do I block them within the SEOmoz crawl diagnostics report?
Moz Pro | | SunshineNYC0 -
Crawler has stopped crawling my website
Hi all, I recently changed my site www.ipbskinning.com to ipbskinning.com. For some reason my weekly scan states that no pages have been crawled. I tried making a new campaign with the sub-domain ipbskinning.com but still the starter crawl returns nothing? Am I doing something wrong? :S Thanks all!
Moz Pro | | pezza34340 -
Blogger ain't working with research tools...
I'm trying to do link research and analysis on my website for dogtraining.blogspot.com however the tool recognizes only blogspot.com giving me fake results....
Moz Pro | | 6786486312640 -
My 2 Target Keywords Rank In Top 10 But Don't Show Up...?
Hi, My 2 target keywords definitely rank in the top 10 in the USA version of Google but they dont show up in SEOMOZ rank checker...I started using SEOMOZ abour a week or so ago and in 2 consecutaive ranking checks they haven't shown up... Market Samurai says they're 4 and 8 respectively, I can see them in the top 10 of Google and various USA proxies show they're in the top 10... Is there a glitch with SEOMOZ or am I doing something wrong? Thanks, James
Moz Pro | | James10 -
What causes Crawl Diagnostics Processing Errors in seomoz campaign?
I'm getting the following error when seomoz tries to spider my site: First Crawl in Progress! Processing Issues for 671 pages Started: Apr. 23rd, 2011 Here is the robots.txt data from the site: Disallow ALL BOTS for image directories and JPEG files. User-agent: * Disallow: /stats/ Disallow: /images/ Disallow: /newspictures/ Disallow: /pdfs/ Disallow: /propbig/ Disallow: /propsmall/ Disallow: /*.jpg$ Any ideas on how to get around this would be appreciated 🙂
Moz Pro | | cmaddison0