Why just 1 Page has been crawled till date?
-
We have started SEO for our nestle-family.com/english/ site.
However, till date only just 1 page has been crawled. What are the reason for the pages not being crawled?
-
Hi Francis,
I hope you've had more than one page crawled by now. If not, check out the help desk article about what to do if only one page is being crawled. http://seomoz.zendesk.com/entries/409821-why-isn-t-my-site-being-crawled-you-only-crawled-one-page.
If that doesn't fix things, it's time to email the help desk at help@seomoz.org.
-
Francis,
The SEOMoz crawler which is indexing your site operates differently than that of what Google, Yahoo and Bing's. Though the SEOMoz tools are extremely useful, you may find more comprehensive results in your Google Webmaster Tools account. To see how many pages google is including from your site, I highly recommend submitting an XML sitemap to Google, Yahoo and Bing. Then, once they have it, you'll be able to see, withing the sitemap area(s) how many pages the engines are including in their index.
This doesn't give you any meaningful data in regards to rankings though. For that, you can use either the SEOMoz ranking check tool and Your site on the area within Google Webmaster tools (left side) that is nested in the following links.
Your site on the web> Search queries
Note that my suggestion of uploading a sitemap is purely based on seeing how many pages are indexed and doesn't consider any SEO strategies such as letting google find you on their own. Which may be better depending on who you ask! For me, I'd upload the sitemap because your incoming links and social media marketing should theoretically have the same effect on your rankings as it would with or without an XML sitemap.
- Randy
-
Thanks Randy. I see the results as 9 for the domain. However, I had entered this URL in SEO Moz, to track and evaluate the performance. But, here it shows that just 1 page is crawled till date. Why would this be the case?
-
I'm getting 9 results for the domain! Try this in your Google search box to see. If you do not get the same results, you might be and probably are in a different location than me. When you use the below query (And anytime you're spot checking rankings) sign out of accounts associated with the engine you're checking. Also, the below query is for google.
site:nestle-family.com/english/
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
GoogleBot still crawling HTTP/1.1 years after website moved to HTTP/2
Whole website moved to https://www. HTTP/2 version 3 years ago. When we review log files, it is clear that - for the home page - GoogleBot continues to only access via HTTP/1.1 protocol Robots file is correct (simply allowing all and referring to https://www. sitemap Sitemap is referencing https://www. pages including homepage Hosting provider has confirmed server is correctly configured to support HTTP/2 and provided evidence of accessing via HTTP/2 working 301 redirects set up for non-secure and non-www versions of website all to https://www. version Not using a CDN or proxy GSC reports home page as correctly indexed (with https://www. version canonicalised) but does still have the non-secure version of website as the referring page in the Discovery section. GSC also reports homepage as being crawled every day or so. Totally understand it can take time to update index, but we are at a complete loss to understand why GoogleBot continues to only go through HTTP/1.1 version not 2 Possibly related issue - and of course what is causing concern - is that new pages of site seem to index and perform well in SERP ... except home page. This never makes it to page 1 (other than for brand name) despite rating multiples higher in terms of content, speed etc than other pages which still get indexed in preference to home page. Any thoughts, further tests, ideas, direction or anything will be much appreciated!
Technical SEO | | AKCAC1 -
Home has DA 50 but Subpages have Page Authority of 1
Hello, we already asked this, but there was no answer. We would be happy for any information. How could it be, that our subpages all have a PA 1 if the home got DA 50? technical specialities: Megamenue opens on click only Category pages dont exist (home/i-do-not-exist-as-page-category/PA-1-subpage) All subpages have a high amount of links to ressources (over 200) subpages are crawled and online for some time what would be the most obvious cause for the low PA? Would the external link profile be the main reason? thanks in advance. I would be happy to answer your questions
Technical SEO | | brainfruit0 -
Crawl depth and www
I've run a crawl on a popular amphibian based tool, just wanted to confirm... should http://www.homepage be at crawl depth 0 or 1? The audit shows http://homepage at level 0 and http://www.homepage at level 1 through a redirect. Thanks
Technical SEO | | Focus-Online-Management0 -
Inner pages with no PA
We recently redesigned our website and we are finding a lot of issues. In particular, our inner pages are not recieving any links.. This did not happen before.. How can I solve this issue? Example: http://www.portaldeldiablo.com.uy/es/alojamientos/botacana Regards, Cecilia
Technical SEO | | ceci27100 -
Does adding subcategory pages to an commerce site limit the link juice to the product pages?
I have a client who has an online outdoor gear company. He mostly sells high end outdoor gear (like ski jackets, vests, boots, etc) at a deep discount. His store currently only resides on Ebay. So we're building him an online store from scratch. I'm trying to determine the best site architecture and wonder if we should include subcategory pages. My issue is that I think the subcategory pages might be good from a user experience, but it'll add an additional layer between the homepage and the product pages. The problem is that I think a lot of user's might be searching for the product name to see if they can find a better deal, and my client's site would be perfect for them. So I really want to rank well for the product pages, but I'm nervous that the subcategory pages will limit the link juice of the product pages. Home --> SubCategory --> Product List --> Product Detail Home --> Men's Ski Clothing --> Men's Ski Jack --> North Face Mt Everest Jacket Should I keep the SubCategory page "Men's Ski Clothing" if it helps usability? On a separate note, the SubCategory pages would have some head keyword terms, but I don't think that he could rank well for these terms anytime soon. However, they would be great pages / terms to rank for in the long term. Should this influence the decision?
Technical SEO | | Santaur0 -
Pages appear fine in browser but 404 error when crawled?
I am working on an eCommerce website that has been written in WordPress with the shop pages in E commerce Plus PHP v6.2.7. All the shop product pages appear to work fine in a browser but 404 errors are returned when the pages are crawled. WMT also returns a 404 error when ‘fetch as Google’ is used. Here is a typical page: http://www.flyingjacket.com/proddetail.php?prod=Hepburn-Jacket Why is this page returning a 404 error when crawled? Please help?
Technical SEO | | Web-Incite0 -
Website of only circa 20 pages drawing 1,000s of errors?
Hi, One of the websites I run is getting 1,000s of errors for duplicate title / content even though there are only approximately 20 pages. SEOMoz seems to be finding pages that seem to have duplicated themselves. For example a blog page (/blog) is appearing as /blog/blog then blog/blog/blog and so on. Anyone shed some light on why this is occurring? Thanks.
Technical SEO | | TheCarnage0 -
How can I prevent duplicate content between www.page.com/ and www.page.com
SEOMoz's recent crawl showed me that I had an error for duplicate content and duplicate page titles. This is a problem because it found the same page twice because of a '/' on the end of one url. e.g. www.page.com/ vs. www.page.com My question is do I need to be concerned about this. And is there anything I should put in my htaccess file to prevent this happening. Thanks!
Technical SEO | | onlineexpression
Karl0