Why so many crawl errors?
-
Our site is showing it has a ton of crawl errors in the back end, mostly concerning duplicate content within our blog. The content is unique however. We know this for certain because it's done in house or put together by some of the freelance writers we work with.
The site is for an RV dealership and we're using a template-based system from a well known company.
Any ideas on what may be causing this?
-
Hi Darrin,
Can you provide your website URL or a few examples of the URLs that are getting the duplicate content error?
If you can't provide them, I would recommend referencing http://www.seomoz.org/help/fixing-crawl-diagnostic-issues which says the following about fixing duplicate page content:
"Duplicate Page Content
Duplicate Content means there are pages that are identical (or nearly identical) to content on other pages of your site, which can force your pages to unnecessarily compete with each other for rankings.
Here are some things you can do about duplicate pages:
Delete content that is similar on each page.
Add some new and unique content to each page that is on the report. This can be done by adding more information, ideas, product descriptions, or anything that can make it differ from other pages on the domain.
You can also add a rel=canonical to one of the duplicate pages. Here are a few ways to do this:
Add a rel="canonical" link in between the and elements. This should be done on the version of the page you want to be ranking or that non-canonical version of the two (or multiple) pages.
To specify a canonical link to the page http://www.seomoz.org/blog.php?item=seomoz-iscool, create a element that looks like this: <link rel="canonical"href="<a href="http://www.seomoz.com/blog.php?item=seomoz-iscool">http://www.seomoz.com/blog.php?item=seomoz-iscool"/></link rel="canonical"href="<a>
Copy this link into the section of all non-canonical versions of the page, such as http://www.seomoz.com/blog.php?item=seomoz-iscool&sort=fun.
Keep in mind that that canonicals will stop the pages from ranking against each other, but they will still show up as duplicate content from a UI perspective, so we will still count them as duplicate."
Thanks,
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Help recover lost traffic (70%) from robots.txt error.
Our site is a company information site with 15 million indexed pages (mostly company profiles). Recently we had an issue with a server that we replaced, and in the processes mistakenly copied the robots.txt block from the staging server to a live server. By the time we realized the error, we lost 2/3 of our indexed pages and a comparable amount of traffic. Apparently this error took place on 4/7/19, and was corrected two weeks later. We have submitted new sitemaps to Google and asked them to validate the fix approximately a week ago. Given the close to 10 million pages that need to be validated, so far we have not seen any meaningful change. Will we ever get this traffic back? How long will it take? Any assistance will be greatly appreciated. On another note, these indexed pages were never migrated to SSL for fear of losing traffic. If we have already lost the traffic and/or if it is going to take a long time to recover, should we migrate these pages to SSL? Thanks,
On-Page Optimization | | akin671 -
Too many onpage links
We got the weekly seomoz reports and see that most of our pages and posts contain too many onpage links. I checked our website and all of our pages have a header, footer and left side menu. I did the math and there are 13 links in the header, 26 links in the footer and 76 links in the left side menu. This means that all of our post and pages have 115 links at the start. So what do I do? Do I remove the left side menu from the posts' layout and use only the footer and header? Or do I add nofollow links? Thanks!
On-Page Optimization | | Romaine0 -
How much content does Google Crawl on your site?
Hi, We've had a debate around the office where some people believe that Google only crawls the first 150-200 words on a page and some people believe that they priority content that is above the fold and other people believe that all content has the same priority. Can you help us? Thanks,
On-Page Optimization | | mdorville
Matt0 -
How many words per page should be have?
Hi, How many words per page should we have? And how many keywords should be in there for optimal ranking> Thanks Andrew
On-Page Optimization | | Studio330 -
Too many links on page -- how to fix
We are getting reports that there are too many links on most of the pages in one of the sites we manage. Not just a few too many... 275 (versus <100 that is the target). The entire site is built with a very heavy global navigation, which contains a lot of links -- so while the users don't see all of that, Google does. Short of re-architecting the site, can you suggest ways to provide site navigation that don't violate this rule?
On-Page Optimization | | novellseo2 -
Why that many Crawl Diagnostics errors, false?
Hi, my fist question, trying to understand how seomoz pro works. I have about 680 crawl erros, but when I check the details, I found this: 1. many 403 errors ( I think from all links). > I have tested my web site (telcelsolcom.com) in other tools and all says OK 200 response. 2. many title and content duplicates, but the system is showing as duplicated pages with and without the www. > I have a 301 redirect from non www to with www and it is working ok. Do I have false errors? What am I doing wrong? thanks.
On-Page Optimization | | hugoaf0 -
Do I really have too many links on my startpage?
My site www.poker-coaching.net is built with Joomla, and I have one main menu that links all articles (app. 120) in one language from the start page. The site has a language selection menu with translations available in 4 other languages, and for each language, there are another 80 articles linked from the main page. The SEOMOZ crawling report now say that I have too many links from the main page. I always thought it was a good thing for SEO to have articles linked from the main page - do I need to restructure my site and start building multi-level menu structures, where I would have a main menu on the start page and the next level menu would only be shown after a user clicks on a main menu item?
On-Page Optimization | | CatfishTPA0 -
Too many on page links on ecommerce site
I have an online store with 10 catagories, many of those have subcategories. I have a tree style navigation menu on the page. This helps people quickly find what they need. However, I end up with about 125 links on the page that way. Does google really penalize me for this? Is there anyway around this? Advice much appreciated!
On-Page Optimization | | bhsiao0