Why is Moz Crawling More Pages Than My Site Actually Has?
-
Hi
I have a site that only has 5k pages but Moz has crawled 50K pages on the site when I initiated the site crawl. I don't exactly know why Moz is reporting me back so many pages but I was wondering why this is and if any of you out in the Moz community know anything about this.
Thanks
-
Hey there! Tawny from Moz's Help Team here.
It's tough to say without being able to look at your Campaign directly, but I can give you a hint! If you go to All Crawled Pages and download the CSV, Column B is the Referrer URL, the page our crawler was on when it found the link to the page in Column A. You should be able to trace our steps backward to find where all these links are coming from on your site.
I hope that helps! If you're still needing some help, please write in to us at help@moz.com with all the details of your issue, and we'll do our very best to sort things out for ya.
Cheers!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz DA is not increasing
Hey my website best offset smokers under $1000 is not increasing DA. is there anyway to increase the DA currently its DA is 8
Moz Bar | | 0hjgh60 -
Https address has different result that http in Page Optimization Score toll in Moz PRO
The following url
Moz Bar | | TrueluxGroup
https://www.whichledlight.com/t/gu10-led-bulbs has (100 score for keyword 'GU10 LED')
has different on page opmisation score results to
http://www.whichledlight.com/t/gu10-led-bulbs (73 score for keyword 'GU10 LED') Anyone know if we've set something up wrong?
Also, is this even something to worry about, does google treat them differently? We're using the Page Optimisation Tool in Moz Pro ** UPDATE ** It's worth mentioning we are using emberjs, so the website is a single page application.
We use prerender to render the pages for google.0 -
Has anyone had to deal with Moz crawl issues on their Zendesk support site?
If so - how did you end up resolving them? For instance we have 85 "temporary redirect" errors from our Zendesk support site in our crawl error report and we don't have access to the robots.txt file through Zendesk.
Moz Bar | | zspace0 -
Duplicate page found with MOZ crawl test?
When I crawl my website www.radiantguard.com, the crawl test comes back with what appears to be a duplicate of my home page: http://www.radiantguard.com and http://www.radiantguard.com/ Does the crawler indeed see two different pages and therefore, are my search engine rankings potentially affected, AND is this because of how my rel canonical is set up?
Moz Bar | | rhondafranklin0 -
Comparing Competitor On-Page Grades?
When I run an advanced SERP report or even the basic keyword difficultly report it gives me competitor On-page grades. I can look directly at their code, but I'm wondering if there is a way to easily see and export a .csv or excel file of the on-page ranking factors for the top 1-10 results comparing them to a page on my site? Seems like that would be really helpful and much quicker than looking at source code to understand what on-page factors are contributing to their success. Is there any way to do this in Moz or a free tool elsewhere you would suggest?
Moz Bar | | K-WINTER0 -
I am not able to perform crawl test in moz tools
it is throwing there is some problem in domain when i try testing the crawl test for my domains
Moz Bar | | IBEE-Hosting0 -
Can't get on page grader to work properly.
Hi I'm trying to optimize my pages with the on page grader tool but it keeps returning an F grade when I know my page is very well optimized. It is like something is blocking the page crawl but I have double checked my robots.txt and can't think of anything else that is causing a problem. I am trying to do www.hydrohobby.co.uk with the keyword hydroponics for starters but it is the same problem with all other page urls on my site and keywords I try to input. This is a new site made with cscart 4.0. I've graded pages on previous versions of this software with no problems. Can anyone help? Rob
Moz Bar | | hydrohobby0 -
On page grades - quick question
My hardwood flooring client just added carpet, luxury vinyl, ceramic tile, area rugs, design, and ceramic tile to his lineup - joy, joy. He really thought the months and months of working together and creating a bunch of solid, original content and promoting it and building links and seeing great results for Hardwood Flooring means he would instantly rank well for ALL flooring. I digress, sorry. I am trying to understand the on page reports a little better. When I grade the new carpet page on his site for the keyword 'carpet' it comes back with an A - when I grade it for 'Carpet, city name' it comes back with an F. Which should I be targeting for best results? 95% of my clients are concerned about local results and not getting business other than within 20-30 miles of their office. Any guidance in understanding on how BEST to utilize the on page reporting would be greatly appreciated! (I did watch the video and check out the guide) Thank you in advance for your time! Matthew
Moz Bar | | Mrupp440
