Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Viewing search results for 'When searching in google we find our site in the first position but when some others search it is seen on the second page 1 st position why is this happening?'
Search Behavior | | Alyaauditors0 -
Google site: search showing twice amount of indexed pages. why?
I have around 50k pages indexed on my site but when I do a google site: of my site it shows around 100k pages indexed. Why is it showing so much more? It is also only showing around 700 pages indexed in my web masters account for the site. Background: We have a custom site map being generated automatically. Let me know if you would like more info, Thanks.
Search Behavior | | Nicktaylor10 -
All pages were returning 404 for an hour. Will it impact the SERPS?
Hi, Due to a bug in my website system, all the pages were returning an 404 default page for a period of 1 hour. Can this event impact the SERPs of this site? (the site is heavily visited, more than 500k users coming from google every day, so I assume google crawls my pages every moment)
Search Behavior | | lucasms0 -
UK & Ireland Websites displaying same page differently in serps
Hi there, I have a Magento Enterprise store based in the UK and we have an Irish version which we created after finding an increasing amount of traffic from Ireland. One thing that I don't understand, is that if I search for one keyword on Google, the websites are displayed differently, when effectively they are identical websites. Here is how a result looks like for my UK store: http://i.imgur.com/NKSt4Qq.png And here is how a result looks like for my IE store: http://i.imgur.com/Cynv8Mz.png They both have the same Meta description, barring a few geographical words and terms. Both have on page descriptions as well as products. Yet the IE results display the description and the UK results display products and a tiny snippet of the description. Any ideas on how I can make my UK pages display like the IE one? Or, just why they are both displayed differently? Thanks
Search Behavior | | tomhall900 -
Looking for something better than Googles in page analytics
Buongiorno from 12 degrees C wetherby UK 🙂 I'm interested in measuring content engagagement, things like what gets clicked on mouse tracking beahaviour etc. Google Analytics in page analytics does a good job but is there another product able to guage user interactive behaviour with content (Yes ive added event tracking). Thanks in advance,
Search Behavior | | Nightwing
David1 -
Dating Blog Posts & How Fast Google Picks up on New Pages
I had until a few months ago included the original post date of a new blog post on the site. I then removed it and none of my results in Google now include the blog post date, although for some (for articles written about events) Google includes the date of the event where you would usually see the post date. Since I did this, it seems like new blog posts are taking longer to rank on Google, some results are ranking well, and others declined relative to what I would have previously expected. What's the best thing to be doing? To include a date (considering a lot of my content is not time-relevant) or to keep it as it is now? The second thing, is I often go through and update my articles with new information and re-post it in my rss feed etc - ie the date becomes new again. How does Google treat this? Any ideas or comments would be great! Thanks
Search Behavior | | ben10001 -
How to get more page impressions?
I'm wondering about one of our web-projects. There's a lot of good interesting content but the statistics of page impressions don't make me very happy. Each user is visiting just 1,5 sites per visit. That's really not much. We have other (similar) projects where this problem does not exist, where user are visiting a lot more sites per visit. I have no idea what could be the reason for it. Do you know / use some tricks to get more page impressions? Thank you, Sally
Search Behavior | | SallyO0