Why Is SEOMOZ No Longer crawling All Of My Site
-
Hi all,
I joined Seomoz over a month ago and Roger has been crawling all of the pages on the site approx 20 pages. Through out the last few weeks I have been working on the errors and notices identified by Roger. However, this week Roger has only re-crawled 1 page and is not picking up all the other pages.
Has any one come across this problem. can you recommend any thing to resolve it?
Many thanks in advance....
-
Hi Greg,
I haven't heard of that one before..hate to sound like a broken record, but best to email the help desk for this one too. Thanks!
-
I am not sure If I have the same problem... I previously had 46 pages crawled and added a couple in the last week. So the last crawl should have said 48. Oddly though, it reads N/A.
I would think a little tooltip should explain what N/A means there. Does anyone know?
-
Hi Echolls, so sorry to hear that. Can you send an email to help at seomoz dot org and let our help desk know? Thanks!
Keri
-
Just chiming in to add that I have the same problem going right now. Worked totally fine for a few days with 200+ pages crawled, now just down to one.
-
The re-crawl today has now picked up all the pages on the site. The problem was only for a few days.... Many thanks
Danny
-
There's a known bug at the moment that we're investigating that has some crawls suddenly dropping down to only a page or two. I believe both of you have sent your information to the help desk, and they'll help you from there. I'm making this comment so anyone else searching the forums in the next couple of days can see this answer as well and just contact the help desk directly.
-
Hi Seb,
Yeah, sent it through now waiting for a reply. Let me know if you have any joy and if it's an error on their behalf?
Many thanks
Danny
-
I did come across that answer but none of them really applies to me. Have sent a help request. Many thanks for your help.
Danny
-
Hi,
I am having the same Problem: Crawled Pages droped from 10k to 1 Pages... send a request for help to help@ allready...
Seb.
-
Here are some common reasons why only one page of your site may be crawled http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page. For more specific help, sending an email to the help team at help@seomoz.org is the best way to get your particular issue looked at.
Thanks!
Keri
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Open Site Explorer purposefully not crawl some sites?
I use both SEOmoz's Open Site Explorer and Web Master Tools to find backlinks when conducting link audits. WMT always finds more links than OSE; I understand Google's database is bigger. But what is interesting to me is that it seems that a large percentage of the links WMT finds that OSE does not are real crappy links that I don't want. That makes me wonder if SEOmoz decides not to crawl certain, low quality, sites? Just curious.
Moz Pro | | ILM_Marketing0 -
Strange nothing site ranking
Hi There. If you check who ranks for "credit cards" there is a website https://www.woolworthsmoney.com.au/ that is in position #5 This is a highly competitive keyword, but OpenSiteExporer.org cannot give me any backlinks for it. it says "No Data Available for this URL" The same thing happens in Market Samurai - no data 1. What are these guys doing that the others are not? 2. How come OSE can't pull any data for it?
Moz Pro | | SearchProduct0 -
SEOmoz Dashboard Report: Crawl Diagnostic Summary
Hi there, I'm noticing that the total errors for our website has been going up and down drastically almost every other week. 4 weeks ago there were over 10,000 errors. 2 weeks ago there were barely 1,000 errors. Today I'm noticing it's back to over 12,000 errors. It says the majority of the errors are from duplicate page content & page title. We haven't made any changes to the titles or the content. Some insight and explanation for this would be much appreciated. Thanks, Gemma
Moz Pro | | RBA1 -
Open Site Explorer Not Working on 99% of Sites
I'm trying to use Open Site Explorer, but whenever I try to I get the error message "Ouch! It Looks Like Something Went South". Interestingly, I don't have this problem when entering a very popular site like google.com, yahoo.com, bbc.co.uk. Is there a problem with the tool at the moment, or something wrong on my end?
Moz Pro | | EssexGirl1 -
How can you set SEOmoz to work with your dev site behind an htpasswd?
All sites need to be developed from the small to the grand - and this takes time. Development usually takes place on a subdomain different from our live domain. It is locked down behind an htpasswd during development so its not picked up by searching engines - that may create duplicate content issues if when the site goes live it has already scanned our site on the development server. Its also a security implementation to keep the site away from prying eyes before its ready for launch There could be security holes that have not been tweaked. Whats the best strategy to get SEOmoz involved in this scenario. Its tools are invaluable to the SEO part of the build - but the seomoz crawler bot has a different IP address (being cloud based) - so we cannot just let a single IP address through our htpasswd. Also is there a way to link the dev and live site in seomoz - so when it goes live to maintain all teh same logs without having to create two seperate site campaigns? Thanks!
Moz Pro | | dseo2410 -
Can Open Site Explorer Do This?
Is there any way to set up Open Site Explorer to show these things for competitor external backlinks: Google Page Rank of the page the backlink is on Google Page Rank of the domain the backlink is on Whether the backlink is a follow or no follow Is this possible in OSE? If not, are there any other SEOMOZ Tools that will do this? Thanks.
Moz Pro | | N5c0 -
SEOMOZ Competitive Domain Analysis
Hi, I am just trying to get to the bottom of why I am seeing such wildly different figures in the SEOMOZ link analysis. The SEO company that we use is saying that we have around 331 external links to our website, when I check on Yahoo site explorer, it returns 264 external links, but in my SEOMOZ campaign manager, it says I have 4 external links? I fully appreciate that none of these methods are going to be wholly accurate, and are going to produce different results, but I can't understand why the SEOMOZ results are so vastly different. I also know for a fact there are a number of Followed links that I have added to a couple of websites, that Google has now indexed (as they appear in search results), but don't appear in the campaign manager results. If SEOMOZ use a different method to assess an external link, then no problem - my main concern here is that as a Newbie I am doing something wrong within the SEOMOZ tools, and don't want to take action based on results that may be incorrect because I have set things up incorrectly? Any help is greatly appreciated. Many thanks, Gareth
Moz Pro | | gdavies090319770