641 Crawl Errors In My Moz Report - 190 are high priority Duplicate Content
-
Hi everyone,
There are high and medium level errors. I was surprised to see any especially since Google Analytics shows no errors whatsoever.190 errors - duplicate content.A lot of images are showing in the Moz Crawl Report as errors, and when I click on one of these links in the report, it directs to the image which displays on a blog post on the site unusually since I haven't started blogging yet.. So it looks like all those errors are because the images are appearing on their own post.So for example a picture of a mountain would be referred to with www.domain.com/mountains ; the image would be included in the content on a page but why give an image a page/post all of it's own when that was not my intention. Is there a way I can change this?# ----------------------------------------
These are things I first see at the top of the Moz Report:There are 2 similar home urls at the top of the report:
http status code is 200 for both (1) and (2)
Link Count for (1) is 71. Link count for (2) is 60.
No client or server errors
Rel Canonical Rel-Canonical Target
Yes http:// domain. co.uk/home
Yes http:// domain. co.uk/home/Does this mean that the home page is being seen as a duplicate by Google and the search engines?http status codes on every page is 200.Your help would be appreciated.Best Regards,
-
Hi ,
Many thanks for responding. Yes definitely a few issues for sure it's been quite frustrating so far and I have been looking at ways to get the site fully correct: Traffic lost, 3 Htaccess files, 2 robots.tx files. A new site was built on a subdomain and then migrated to the live domain.
I looked at the file structure and I saw lots of duplicate images on the subdomain where the new version of the website was created, and lots of duplicates on the current site. I will be running another Moz Crawl test to see if the removal of the duplicates makes an impact on the 190 errors. I will keep you updated so please leave this topic discussion. I think perhaps part of what has happened is that some of the images have previously uploaded but have not loaded into the right folder, but to the home directory (hence to domain.com/exampleimage instead of domain.com/wp-content/uploads/exampleimage. Also I think that an add was done during the migration which was done by a 3rd party, instead of doing a replacement of the destination files; but I can't confirm or guarantee this.
- I will check the link that you kindly left. It's 4am here in the UK so I will read it before I retire for the evening:
https://moz.com/community/q/cms-pages-multiple-urls
- The CMS is WordPress
Many thanks for your time and for your much needed reply.
Kind Regards.
-
Hi there,
Sounds like you are dealing with a bunch of issues here.
I suggest the first thing you address is the trailing slash issues
http:// domain. co.uk/home
http:// domain. co.uk/home/are different urls in Googles eyes despite being the same on your website.
To fix this take a loot at a previous post by myself figuring it out
https://moz.com/community/q/cms-pages-multiple-urls
This should hopefully cut down the number of errors appearing dramatically. Make sure your only ever using one version of link either with or without a trailing slash. Make the decision and always use that format.
As for your images appearing on a page of their own. We would need to know your CMS platform. A link to your site would also be helpful as you have so many errors its kinda a stab in the dark to figure it out for you without looking
-
I did find this on Moz dating back to 2014 and there was still no fix for the problem back then?
https://moz.com/community/q/duplicate-content-wordpress-image-attachement
Please can you help. Thank you
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
My automated build system is creating a duplicate website
Because of the tools my company is using for CI/CD (A CI/CD pipeline helps you automate steps in your software delivery process, such as initiating code builds, running automated tests, and deploying to a staging or production environment.) an extra URL is generated. The canonical for the generated site is that of our main website, but other than that it is the same website. Could this new URL compete with our website? Will Google count it against us since it is the same content BUT with canonical (it is not noindex-ed)? Does it matter? Surely others are using this method? Answers/thoughts will be greatly appreciated. Thank you.
Reporting & Analytics | | RoxBrock0 -
Why might my websites crawl rate....explode?
Hi Mozzers, I have a website with approx 110,000 pages. According to search console, Google will usually crawl, on average, anywhere between 500 - 1500 pages per day. However, lately the crawl rate seems to have increased rather drastically: 9/5/16 - 923
Reporting & Analytics | | Silkstream
9/6/16 - 946
9/7/16 - 848
9/8/16 - 11072
9/9/16 - 50923
9/10/16 - 60389
9/11/16 - 17170
9/12/16 - 79809 I was wondering if anyone could offer any insight into why may be happening and if I should be concerned?
Thanks in advance for all advice.1 -
Why might my websites crawl rate....explode?
Hi Mozzers, I have a website with approx 110,000 pages. According to search console, Google will usually crawl, on average, anywhere between 500 - 1500 pages per day. However, lately the crawl rate seems to have increased rather drastically: 9/5/16 - 923
Reporting & Analytics | | Silkstream
9/6/16 - 946
9/7/16 - 848
9/8/16 - 11072
9/9/16 - 50923
9/10/16 - 60389
9/11/16 - 17170
9/12/16 - 79809 I was wondering if anyone could offer any insight into why may be happening and if I should be concerned?
Thanks in advance for all advice.0 -
Moz Crawl shows over 100 times more pages than my site has?
The latest crawl stats are attached. My site has just over 300 pages? Wondering what I have done wrong? RRv3fR0
Reporting & Analytics | | Billboard20120 -
Strange Traffic / Viewed content in Analytics
Hi Im looking at the content viewed in December for a clients site and there's a high number of page views for some non-existent pages which received multiple hits eg. domain.com/dr-capability/ with 241 page views (54 unique page views) How can you have multiple page views (and many unique page views) for pages that don't exist ? Is it possible page is being generated automatically or something ? if so how come ? Any ideas as to whats causing this much appreciated ? All Best Dan ps - also many above average home page views
Reporting & Analytics | | Dan-Lawrence0 -
SEOMoz crawls skewing Avg Visit Duration in Google Analytics
Hello, We are a UK based company. Our Google Analytics account is showing a rise in Avg Visit Duration for 'Direct traffic' since we started using SEOMoz. Are any other users experiencing this issue? We tracked it down to City Seattle, and when doing an Advanced filter by removing Seattle, the results are normal again. What does SEOMoz or other users recommend we do besides continuously using advanced filters? We have enquired about excluding Roger's IP address, but have been told that Roger uses the Amazon cloud, so the IP is not static. See attachment for screenshot of our Google Analytics account of Avg Visit Duration since we began with SEOMoz. Rich Talbot 718g3.gif
Reporting & Analytics | | STL1 -
How can you tell if your new content has been indexed?
Other than simply doing a search in each case, is there any way I can tell (in Webmaster Tools, for example) if the 500-1000 new pages of content I have added have been indexed and are now appearing in search results? My traffic hasn't risen much, but I know at least a few of them are in there... How can I tell when they're all in?
Reporting & Analytics | | corp08030