Why would only 1 pg of an 18 pg site be crawled?
-
I signed up yesterday. Added 4 sites. The one I really need data on now has only had 1 page crawled. The other sites have had almost all pages crawled (over 40 each) in one day.
What is wrong?
The main domain has a 301 redirect to another domain name is that the problem?
Is there something wrong at Google analytics? I dont manage this site and I'm picking up behind another firm..where should I start my discovery?
Thanks so much!
-
Here are some common reasons why only one page may be crawled in your SEOmoz campaign. Let us know if one of these isn't the cause and we'll dig deeper!
-
What's the URL? or URLs of the main domain redirected and the domain you are expecting to get indexed?
-
I will check the nofollow, but I'm feeling like it is the 301 redirect from one top-level domain to another. The target domain has NO link juice at all and it has been live for about 6 months. Its possible the redirect site has not been seen by Moz, but its been on the web for the exact same time as the referrer domain.
-
One day is not a long time but look at the code on the site if you suspect something is wrong.Check out your meta robots tag and make sure you're not noindexing or nofollowing. Check your robots.txt file to make sure you're not blocking.
Or you can run this http://www.xml-sitemaps.com/ sitemap generator and see if the are crawling your pages or bailing on the first page. If they are crawling your site Google most likely is unless you are specifically disallowing Googlebot which I doubt.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Ajax4SEO and rogerbot crawling
Has anyone had any experience with seo4ajax.com and moz? The idea is that it points a bot to a html version of an ajax page (sounds good) without the need for ugly urls. However, I don't know how this will work with rogerbot and whether moz can crawl this. There's a section to add in specific user agents and I've added "rogerbot". Does anyone know if this will work or not? Otherwise, it's going to create some complications. I can't currently check as the site is in development and the dev version is noindexed currently. Thanks!
Moz Pro | | LeahHutcheon0 -
Crawl test from tools
Hi, I notice that the crawl test which is from the Research Tools doesn't really get a new crawl even though there is 2 crawl per day. It will only provide the data which was acquire from the crawl diagnostics in my pro account. There is no point for me to get the data which I get from my crawl diagnostic isn't it? Even seomoz provided with more than 2 crawl per day also useless in this case. This whole thing doesn't make sense as the crawl diagnostics will only perform a full crawl test once every week. but even the crawl test also not helping any thing out for me.
Moz Pro | | hanzoz0 -
Unable to crawl pages
Hi, I am trying to set up a campaign for our website - www.salvationarmy.org.au however, I can't seem to get a scan of more than three pages. I have tried the following: www.salvationarmy.org.au (only 2 pages) www.salvationarmy.org.au/home (only 1 page) salvationarmy.org.au (only 3 pages) There is a geo IP redirect on www.salvationarmy.org.au but the second domain listed above should resolve the full site. I'm a newbie to SEOmoz so any help would be appreciated! Thanks, Mel
Moz Pro | | KingPings0 -
SEOMOZ Crawling Our Site
Hi there, We get a report from SEOMOZ every week which shows our performance within search. I noticed for our website www.unifor.com.au that it looks through over 10,000 pages, however our website sells less than 500 products so not sure why or how so many pages are trawled? If someone could let me know that would be great. It uses up a lot of bandwidth doing each of these searches so if the amount of pages being trawled reduced it would definitely assist. Thanks, Geoff
Moz Pro | | BeerCartel750 -
Does SEOmoz work for fully secure sites (https)?
We have created a large file sending service (https://digitalpigeon.com) and for obvious reasons we have secured the entire site (we used to have a trial file send form on the homepage so it made sense to secure everything with 301 redirects from http to https) Because we, somewhat naively, started out with a memorable name and domain - Digital Pigeon - where all of our competitors just keyword stuffed their domains we don't really rank for any useful keywords yet. For me, building domain authority via links is more important right now that any on page SEO that is going to be trumped by google's infatuation with domain keywords anyway. Here's the problem though, it seems SEOmoz and even Google Webmaster Tools and Bing Webmaster Tools all fail to take into account inbound links for both http and https for any reports or analysis! I'm wondering if utilising SEOmoz PRO for keeping tabs on our MozRank is pointless if it's not accounting for all inbound links
Moz Pro | | DigitalPigeon0 -
Why is the SEOmoz customer service on this site so awful?
Half the time the tools don't work and there isn't any accountability. Has anyone else had the same experience?
Moz Pro | | wpsoule1 -
Crawl Diagnostics Summary
Sorry if I am not asking in the right place. On Crawl Diagnostics Summary it says this right..?? : "To get you started quickly Roger is crawling up to 250 pages on your site. You should see these results within two hours. The full crawl will complete within 7 days.". so it's passed a day and it still doesn't show nothing. It says "Processing Crawl Data for 358 pages" How much should i wait??
Moz Pro | | Dussk0 -
Only 1 page has been crawled. Why?
I set a new profile up a fortnight ago. Last week seomoz crawled the entire site (10k pages), and this week has only crawled 1 page. Nothing's changed on the site that I'm aware of, so what's happened?
Moz Pro | | tompollard0
