Why isn't seo moz properly crawling my site?
-
In my campaign results, only 2 pages have been crawled, when there are many more. Also, when I do the on-page evaluation for my homepage and the main keyword, I get a grade of F, with a ton of errors that my page actually does not have. It's as if SEO moz is having trouble crawling through my site.
Any ideas on this?
-
Do you mind posting your URL so we can have a loot at it?
-
Thanks for the replies, but it never got past 2 pages crawled. I have no idea why this is. I got a message saying it may have something to do with user-agent discrimination, but I googled that and there's actually no one talking about it on the internet.
Google isn't indexing my site either. It's not a robots.txt problem, I've had that looked at. The only thing that has changed is that I upgraded the site from cscart v3 to v4. Not sure how that could change anything.
-
Yeah i'd give it a week. It will tell you on your campaign exactly when the next full-crawl is scheduled for. Wait for this date if you haven't already.
Otherwise contact their support team. The Moz team is quick to respond and a helpful bunch. Just don't call them SEOMoz or Rand will track you down and give you a frowny-face.
-
Hi -
Is it the Initial Crawl or Full Crawl ?
If its initial crawl, may be you should wait for the final crawl report. However, just a query - have you checked like - Are your pages not getting blocked by meta noindex or through robots tag... What are the sort of errors you getting
For further info should read this article that why the pages do not get crawled https://seomoz.zendesk.com/entries/409821-Why-Isn-t-My-Site-Being-Crawled-You-re-Not-Crawling-All-My-Pages-
If you still feel an issue - may be can write directly to Moz staff on - help@moz.com
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate Content & Title Tag Group Fields on MoZ Report
Hello, On my SEO MOZ exported Site Crawl CSV report, I have columns for Duplicate Content Group & for Duplicate Title Tag Group. The values in the columns are numerical - 20, 5 , 15, etc. Can anyone explain to me what these values represent and how I can fix the issues I presume they represent? Thank you,
Moz Bar | | AED-1
Scott0 -
How do I disallow crawl on a directory when it's a prefix to my site's URL?
I am trying to disallow our media repository (hosted elsewhere, but appears as a directory on our site) from being crawled by robots but it is not a subdirectory of the site, it's a prefix. So I need to disallow: mediabank.mywebsite.org Not: mysite.org/mediabank What would I need to put in my robots.txt and/or the other host's robots.txt to make this happen? Thanks!
Moz Bar | | Simon-Plan0 -
Why is Moz Crawling More Pages Than My Site Actually Has?
Hi I have a site that only has 5k pages but Moz has crawled 50K pages on the site when I initiated the site crawl. I don't exactly know why Moz is reporting me back so many pages but I was wondering why this is and if any of you out in the Moz community know anything about this. Thanks
Moz Bar | | drewstorys0 -
I have recently switzed to SSL on ramxpert.dk, now Moz is not able to crawl the site anymore
Hi Moz I have recently switzed to SSL on ramxpert.dk, now Moz is not able to crawl anymore. When I look at the crawl report there is just one fault displayed: "403 : Received 403 (Forbidden) error response for page." How can i solve this issue asap? I was not aware that there would be any issues with moz when activating a SSL certificate on the site. The campaign with the problem is: ramxpert.dk. Regards
Moz Bar | | WebBoost
Jesper Nielsen0 -
Moz Content --- for SEO or simply user engagement?
What is the primary function of Moz Content? It looks like it is most useful for managing content as a user engagement tool. Our content strategy is centered on boosting organic placement - with user engagement as a nice but unessential side product. Besides providing general descriptive details of a site's content / authorship - how can Moz Content help with SEO?
Moz Bar | | cvonhassell0 -
Moz / more changes on the way?
I love Moz and the community and all the tools here. I admit I haven't rolled around in all the new things rolled out a few months ago. I thought there were more changes on the way but I wasn't sure if those already happened and I missed them or if I need to be patient? Affiliate program, client reporting? Thanks for any response. Have a great weekend! Matthew
Moz Bar | | Mrupp441 -
Beta Moz is losing my campaigns.
I've been trying to make the transition to Beta especially now that Pro has such serious problems with the style sheet. The thing is, all of the campaigns I have added to the Pro side don't show up in the Beta side. They'll show in Pro but that's all but unusable on my end and there's no Archive button visible on Beta. I tried adding a campaign again to Beta thinking it just isn't there, but it tells me it's already been added. Well then were is it? I just added them earlier today! I can see them on Pro but nowhere on Beta, nor the other 3 I have added on Pro in the last 2 weeks.
Moz Bar | | seowhat0 -
Given that I am currently using a bot sniffer...How can I identify the MOZ bot in order to whitelist it?
MOZ is currently blocked from crawling my sites because I use a bot sniffer. Does anyone know how I can properly identify the MOZ bot in order to whitelist it? MOZ is using Amazon web services and thus employs thousands of dynamic IPs to crawl.
Moz Bar | | Felix_LLC0