Why is the exact same URL being seen as duplicate and showing an error in my SEO reports
-
Well, I am still having duplicate page issues.
I have a question about one of the errors SEO is giving me when I download a crawl report. I am going to attach a screen shot of part of the report so you can see for yourself, along with explaining it here.
SEO shows the list of URL's that it crawled in the report. In this(see attachment) portion of the report it has 321 results for the exact same URL. It also says all of these exact same URL's have received a 404 error. What I want to know is how does it make 321 results for the same URL? And with this error that I don't see when I look at the page?
-
Hey Josh,
You may want to speak with your developer on this one PHP is a server language and could be generating the unique pages and causing Roger to crawl twice depending on which way he approaches the page. I apologize for the delay here as I was not receiving notifications on this post.
-
I think it does so by PHP. Is there any easy way I can make sure?
-
Hey Josh,
Rogerbot discovered this link through the /blog/ subfolder on your page which led him to the which battery post. By any chance does the auto forward do so by PHP or Javascript? Sometimes Roger can get a little hung up on these pages and think they don't exist.
Let me know either way so we can get this taken care of!
Thanks
-
Ok I get which page it is now but I do not understand the issue. There isnt a direct link to that blog post from any of the other pages crawled. And if you use either link they both work. The Column a link however does auto forward to the MaxAmps site equivalent page. Could it somehow have to do with this?
-
Hey Josh,
This is James from Moz Help. I'd like to see if I can assist in diagnosing this problem. I had a chance to pull your crawl .CSV and the 321 pages you have in column F are actually the referring pages the actual page we crawled will be in Column A. Essentially the What Battery Can we MaxAmps Build for You has 321 unique pages it links too. While this page does not 404 it seems Roger can not get to the pages after this.
Feel free to follow up here or send us a message to help@moz.com
Have a great day!
-
Okay I will be sure to try and implement this to the blog.
You seem to know how a php dynamic site builds itself from one page. May I ask you another question? We have been going through this duplicate page problem for a long time. I generally get the answer to redirect or canonical the pages. I understand how I can do this to our blog as it is in word press. However, the rest of our site is not. The category section of our page, for instance, generates depending on how the person gets there from one single page of coding. And that is for all of our categories, not just one. How can I implement a redirect or canonical to this type of site. I would not want all of the categories to lead to one particular category. So if I put the canonical tag in my category page with a single url than that won't work. Also if I use a redirct in this page it will still lead me to only one category (correct?) instead of the people having the option to go to several different categories.
-
Hi Josh,
By chance does this url have parameters. Those may not be reporting properly in this report. That would be my first thought. I have seen that frequently in blog / forum crawls, as those usually have many parameters for starting at a certain post number. The simple solution is to just rel canonical the page to its root.
As for the 404 error I would guess that some page is generated or linking to urls with certain parameters that the page itself doesn't know how to handle.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL country
My url says we are in Germany but we are actually in the US. We do not have offices Germany either. How can I fix my url so it says US?
Moz Bar | | heidiodonnell0 -
Site crawl warning - concatenated urls from Wordpress
I could use some help on how to fix this. I asked at the walkthrough but was told it was a Wordpress issue but so far I can't find anything to point me in the right direction. There are no errors in the files on server side and I have asked my hosting company too. I am hoping someone here may be able to shed some light on it. One of my websites it giving 404 errors on links that are formed as below and there are over 12.7K of them! Example: <mydomainurl>/www.instagram.com/www.instagram.com/<instagram username=""></instagram></mydomainurl> The link that relates to my website is valid and working, but I don't understand the rest. I am totally stumped on how to move forward with this. Any advice, suggestions, tips on how to fix these errors and stop these types of links getting generated. Thanks.
Moz Bar | | emercarr0 -
Moz Crawl Report showing non-existent Duplicate Errors since new reporting layout
Hi Moz Community, Since Moz changed to the new style of Crawl report, we've seen a jump in duplicate errors for our site. These duplicate errors do not exist and were not present on the Crawl reports before the report change and also we have not made any changes to the flagged pages on our site since then either. When you download the report data in csv it appears that the Moz report is mixing up data for two or more pages on the site. e.g.in csv for 'Page1' data, it will show the meta description for 'Page2' and 'Page2' shows that for 'Page1', so this then gets flagged as duplicate, however looking at the actual Meta description assigned onsite, both Page 1 and Page 2 are completely unique. Has anyone else experienced this and Moz Team - are you looking into this? Thanks, V
Moz Bar | | WWTeam1 -
Canonicals in crawling reports
The crawling reports gives info about several meta data missing, what about the lack of a canonical tag? This would be nice too... and images without alt tag (or empty).
Moz Bar | | KBC0 -
Correcting a 4xx on my crawl report
How can I correct a 4xx error on my crawl report. This page no longer exists. What can I do?
Moz Bar | | henne0 -
Custom Reporting cannot be set to daily???
Hi, I created a custom report and scheduled it to be sent daily on my email, the problem is even though I set it to daily the next reporting is always weekly? My other daily reports are working fine except this one. Can anyone shed a light on this and why it's happening. Thanks
Moz Bar | | en-gageinc0 -
Adding a logo to a custom report
Hi Guys, I am trying to work out how to add my logo to a custom report? Can someone explain the process to me? Thanks!
Moz Bar | | StoryScout0 -
Why do my top linking domains according to Webmaster tools, not even appear in my OSE report?
I know the Google index is obviously a lot larger than the MOZ index...but.... I have 8,000 links from blogspot.com according to Webmaster tools, and just one link according to OSE I have 600 links from an online dictionary according to Webmaster tools, not one is mentioned in my OSE report. I'd go so far as to say most of my top 10 linking domains according to Webmaster Tools, don't even have a single mention in my OSE report. We've been hit hard by Penguin 2.0 and I want to look at our link profile.....it seems OSE may be great for looking at my competitors link profiles, but for my own site it seems to be, well, not very accurate at all! So from a trying to do undo the damage caused by Penguin 2.0 point of view, should I just use webmaster tools and forget about OSE? Thanks!
Moz Bar | | MarbellaSurferDude0