Why Is SEOMOZ No Longer crawling All Of My Site
-
Hi all,
I joined Seomoz over a month ago and Roger has been crawling all of the pages on the site approx 20 pages. Through out the last few weeks I have been working on the errors and notices identified by Roger. However, this week Roger has only re-crawled 1 page and is not picking up all the other pages.
Has any one come across this problem. can you recommend any thing to resolve it?
Many thanks in advance....
-
Hi Greg,
I haven't heard of that one before..hate to sound like a broken record, but best to email the help desk for this one too. Thanks!
-
I am not sure If I have the same problem... I previously had 46 pages crawled and added a couple in the last week. So the last crawl should have said 48. Oddly though, it reads N/A.
I would think a little tooltip should explain what N/A means there. Does anyone know?
-
Hi Echolls, so sorry to hear that. Can you send an email to help at seomoz dot org and let our help desk know? Thanks!
Keri
-
Just chiming in to add that I have the same problem going right now. Worked totally fine for a few days with 200+ pages crawled, now just down to one.
-
The re-crawl today has now picked up all the pages on the site. The problem was only for a few days.... Many thanks
Danny
-
There's a known bug at the moment that we're investigating that has some crawls suddenly dropping down to only a page or two. I believe both of you have sent your information to the help desk, and they'll help you from there. I'm making this comment so anyone else searching the forums in the next couple of days can see this answer as well and just contact the help desk directly.
-
Hi Seb,
Yeah, sent it through now waiting for a reply. Let me know if you have any joy and if it's an error on their behalf?
Many thanks
Danny
-
I did come across that answer but none of them really applies to me. Have sent a help request. Many thanks for your help.
Danny
-
Hi,
I am having the same Problem: Crawled Pages droped from 10k to 1 Pages... send a request for help to help@ allready...
Seb.
-
Here are some common reasons why only one page of your site may be crawled http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page. For more specific help, sending an email to the help team at help@seomoz.org is the best way to get your particular issue looked at.
Thanks!
Keri
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Crawl Test: WordPress sites with and without /feed and /trackback entires?
I have multiple WP websites and on some of the websites, on my Moz Crawl test, I see an entry for every blog post but also entries for /feed and /trackback for that single blog post. For example, www...com/someArticle www....com/someArticle/feed www...com/someArticle/trackback 1. Can anyone explain why the Crawl test is picking up the /feed and /trackback items? Is it simply because they are 301 redirects to the original post (www...com/someArticle)? 2. What setting(s) in WordPress are making this information appear? Or is it just that the site(s) that have the /feed and /trackback are displaying "normal" behavior for a WP site with a lot of trackbacks and feed entires? 3. Should /fee and /trackback, as well as /author be blocked in robots.txt? Thanks in advance for your advice and input!
Moz Pro | | Titan5520 -
Having 1 page crawl error on 2 sites
Help! A few weeks back, my dev team did some "changes" (that I don't know anything about), but ever since then, my Moz crawl has only shown one page for either http://betamerica.com or http://fanex.com. Moz service was helpful in talking about a redirect loop that existed, and I asked my team to fix it, which it looks to me like they have. Still, 1 page. I used SEO Book's spider tool and it also only sees 1 page, and sees the sites as http://https://betamerica.com (for example), which is just weird. I don't know enough about HT Access or server stuff to figure out what's going on, so if someone can help me figure that out, I'd appreciate it.
Moz Pro | | BetAmerica0 -
Why is my crawl STILL in progress?
I'm a bit new here, but we've had a few crawls done already. They are always finished by Wednesday night. Our website is not large (by any means), but the crawl still says it's in progress now 3 days later. What's the deal here?!?
Moz Pro | | Kibin0 -
Not all pages are being crawled
I am set up on the PRO plan, I was under the impression that it would crawl up to 10,000 pages. My site has just over 200 pages, but whenever I am crawled it only crawls 121 pages. Is this normal? It's hard to know how reliable my data is because a significant amount of pages are missing.
Moz Pro | | KristinHarding0 -
Settings to crawl entire site
Not sure what happened but I started a third campaign yesterday and only 1 pages was crawled, The other two campaigns has 472 and 10K respectively. What is the proper setting to choose in the beginning of campaign setup to have the entire site crawled. Not sure what I did different and I must be reading the instructions incorrectly. Thanks, Don
Moz Pro | | NicheGuy210 -
Issue in number of pages crawled
i wanted to figure out how our friend Roger Bot works. On the first crawl of one of my large sites, the number of pages crawled stopped at 10000 (due to the restriction on the pro account). However after a few weeks, the number of pages crawled went down to about 5500. This number seemed to be a more accurate count of the pages on our site. Today, it seems that Roger Bot has completed another crawl and the number is up to 10000 again. I know there has been no downtime on our site, and the items that we fixed on our site did not reduce or increase the number of pages we had. Just making sure there are no known issues with Roger Bot before I look deeper into our site to see if there is an issue. Thanks!
Moz Pro | | cchhita0 -
SEOmoz pro campaign keyword rankings.
Using the tools in the SEOmoz pro repertoire I have inserted keywords. Will the rankings tool show me the rankings for any of my pages on the site that have listed for this keyword, or just the home page?
Moz Pro | | CompleteOffice1 -
Historical error info on SEOMoz?
Is it possible to get a report of errors that were on a site back in April? Does SEOMoz keep that data available? There was a big decline in the number of errors on one of my sites and I'm trying to go back and see what it was. --Steve
Moz Pro | | Aggie0