URLS appearing twice in Moz crawl
-
I have asked this question before and got a Moz response to which i replied but no reply after that.
Hi,
We have noticed in our moz crawl that urls are appearing twice so urls like this - http://www.recyclingbins.co.uk/about/ www.recyclingbins.co.uk/about/
Thought it may be possible rel=canonical issue as can find URL's but no linking URL's to the pages.
Does anyone have any ideas?
Thank you
Jon
I did the crawl test and they were not there
-
Hey Jon!
There are only two ways for these URLs to be picked. Relative links in the source code or malformed sitemaps if the <loc>tags are not on the same line as the URL</loc>
Incorrect:
<loc>www.domain.com</loc>
correct:
<loc>www.domain.com</loc>
If the linking page or referral URL is the sitemap, look in the source for the tags. If they are from another linking page, look for hyperlinks missing http://
-
Hi Jon,
Just to clarify is your report showing the domains with http and without, or with www. and without as the duplicate content?
i have seen this issue on a couple of my sites where it is reporting with and without www. and have just implemented the rel canonical to point towards one or the other as i am very confident that this will resolve the issue.
I'll let you know the outcome.
Regards,
Ben
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Utilizing the Moz Location in keywords vs including the location in the actual keyword phrase
I've searched the Moz blog as well as Q&A forums - but I specifically have a question about utilizing the Moz Location in keywords vs including the location in the actual keyword phrase. I've done both and get different rankings. For instance, I have "it company" with the Location set to Corpus Christi, Texas and our rank is #3. Then I also have "it company corpus christi" with the Location set to Corpus Christi, Texas and our rank is #6. Additionally, I threw in "it company corpus christi" with the Location set to National and our rank is #7. What is the best practice and what are the determining factors for the differences? Thank you in advance!
Moz Bar | | LBoxerger0 -
If we put the disavow links in google, does MOZ crawl the same links?
I have put bad or spam links in disavow file, but still showing in MOZ backlinks. So, I want to know that Why is MOZ not removing the spam links from their system?
Moz Bar | | insidewebanalytics0 -
Any Moz staff out there with Magento experience?
Would be great to hook up with Moz staff that are Magento-integration savvy. Or maybe qualified users . . . Need to go through Magento Admin in order to correct errors found in Site Crawl. Thanks, Steve
Moz Bar | | spiderx.ing0 -
URL not returning a page successfully
I am trying to use the on page grader however it is not working with my website. The url is: http://www.britishhardwoods.co.uk/ Can anyone help?
Moz Bar | | British_Hardwoods0 -
Rank Tracker - URLs are Different when Exporting to CSV
When exporting to CSV in Rank Tracker, many of the URLs are reduced to the root domain instead of the full, ranking URL as seen within the tool. Right now the URLs must be copied/pasted or manually edited afterwards in the CSV. However, it doesn't happen to every item. A few of them do show the correct URL after being exported. Any idea if this is a bug or just an odd thing the export does?
Moz Bar | | AlfredGoldberg1 -
Moz bar issues? Does anyone else have them?
At times it's unbelievably slow and other times it doesn't show any link data. It's not just on my computer, it's on other office computers too. I'm using Google Chrome and have tried removing the mozbar and reinstalling from the chrome bar.
Moz Bar | | iresources2 -
Why does Moz Analytics drop my Google Analytics connection every time I login?
I get the following message every time I check the Moz Analytics dashboard on any of the sites I manage. It seems like a bug in the system. Does anyone know how to fix it? "We lost connection with your Google Analytics account. Don't worry — you won't lose any data. Please reauthorize now."
Moz Bar | | cbizzle0 -
Crawl Diagnostics: Exlude known errors and others that have been detected by mistake? New moz analytics feature?
I'm curious if the new moz analytics will have the feature (filter) to exclude known errors from the crwal diagnostics. For example, the attached screenshot shows the URL as 404 Error, but it works fine: http://en.steag.com.br/references/owners-engineering-services-gas-treatment-ogx.php To maintain a better overview which errors can't be solved (so I just would like to mark them as "don't take this URL into account...") I will not try to fix them again next time. On the other hand I have hundreds of errors generated by forums or by the cms that I can not resolve on my own. Also these kind of crawl errors I would like to filter away and categorize like "errors to see later with a specialist". Will this come with the new moz analytics? Anyway is there a list that shows which new features will still be implemented? knPGBZA.png?1
Moz Bar | | inlinear0