Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Search Behavior | | Alyaauditors0 -
List all keywords from a website per page in a table??
Hi all, Very basic question I know but strangely cannot find a solution to it? (its 20:40 on a Fri-night! 😉 ) I am working on a website that has over 100 pages and would like to see all the keywords associated with each page maybe in a table report of some kind? Is this at all possible? Heres an example URL KEYWORDS /index.html Moz, Moz local, London /aboutmoz.html Moz. Moz SEO, London and so on....
Search Behavior | | darrenbooy0 -
Blocking links from being crawled
For my blog, should I block category, "read more" and author links from being crawled by search engine robots? Is it good for SEO? Thanks
Search Behavior | | uesat0 -
UK & Ireland Websites displaying same page differently in serps
Hi there, I have a Magento Enterprise store based in the UK and we have an Irish version which we created after finding an increasing amount of traffic from Ireland. One thing that I don't understand, is that if I search for one keyword on Google, the websites are displayed differently, when effectively they are identical websites. Here is how a result looks like for my UK store: http://i.imgur.com/NKSt4Qq.png And here is how a result looks like for my IE store: http://i.imgur.com/Cynv8Mz.png They both have the same Meta description, barring a few geographical words and terms. Both have on page descriptions as well as products. Yet the IE results display the description and the UK results display products and a tiny snippet of the description. Any ideas on how I can make my UK pages display like the IE one? Or, just why they are both displayed differently? Thanks
Search Behavior | | tomhall900 -
Is it possible to know if visitor arrived at the web page via organic search and if so, show some content?
Hello, Is it possible to know if visitors are arriving at a web page via organic search? Background: We have a section of job description pages to explain typical tasks. These have very high bounce rate (some 100%), and I think people are confusing them with actual jobs. For example "stage designer". Many of those keyword we have very high rankings. I am thinking of having a small notice at the top of those page to say something like "if you are stage designer job, check out our job section". Thanks
Search Behavior | | CreativeChoices0 -
Is a Shorter Page Title Better?
Is there any evidence that SEs give a greater weighting to keyword phrases in the page title if there are less characters? For example: 1. "Buy Silver Bullion" 2. "Buy Silver Bullion Coins Bars Rounds Easily Privately Securely" The key phrase I am trying to optimize for is "Buy Silver Bullion." To my knowledge, current practices would say the 2nd phrase is better optimized since it contains more keywords and it has a few USPs. But is there any evidence that the 1st example would be higher ranked in google for the phrase "Buy Silver Bullion" because it is more focused than the 2nd?
Search Behavior | | nwright0 -
Hi guys.. post-penguin my website coming in and out of serps every other day... what reason for that? ie. #11 --> #300+
We had one of the pre-penguin "unnatural links " messages in WMT - then Penguin hit April 24th/25th.. wee then set to work on Link profile... since 19th May we have had numerous search phrases come 'back' into rank pre-penguin for a day ie.. #5 - #10 and then drop the next.. ie 300+ this has been happening across a wide range of key phrases.... in fact it may well be that the key phrases are added to the serps 'briefly' or for a set amount of time... but our ranking checker checks daily so while it appears to be every other day in and out there may be another pattern... but the question is What is Google doing here and Why? any suggestions?
Search Behavior | | Geminineil1 -
Would you say it is more bennificial to seperate keywords in the title tag tag of a page using a common ( keyword , keyword | Domain.com) or using a hyphen as SEOmoz best practices reccommends (keyword - keyword | domain.com)?
Title tag best practices according to seomoz is the following keyowrd - keyword | brand.com but I have seen some interesting results from using a comma as to a hyphen to seperate keywords as reccomended and wanted to know which method is more crawler friendly.
Search Behavior | | JHSpecialty0