Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google not giving ranking to the intended page of my website.
Hello friends, This is my very first question, I hope I will explain my issue correctly. I have created two pages related to SSC CGL keyword on my website: https://www.ibtindia.com/ssc-cgl-notification-exam-date 2) https://www.ibtindia.com/ssc-cgl-apply-online I want to target the keyword SSC CGL Apply Online on the 2nd URL but Google is only considering the 1st page for all the "apply" related keywords as well. Can anyone suggest to me how to get the second page in rankings for its intended keywords? I will be very thankful for this help. I tried adding image but its showing dummy. Please you can check it op GOOGLE SERP Second page
Search Behavior | | namitathakur0 -
Help Me With These Horrible Crawl Errors
I am currently using Opencart to run a fairly popular ecommerce website. I have done quite well in terms of rankings so far. However, the Opencart platform only goes so far. There are endless amounts of crawl errors, from duplicate content down to missing meta tags. There is no easy way to add canonical tags. The pages that are being listed in the crawl errors seem to be mainly search URL's that i have no idea how Moz found them. An example of the page is: .....com/index.php?route=product/search&tag=home+office+flooring Which has ten duplicate pages all missing meta tags. I have used Google webmaster tools and htaccess to deny access to these pages with the slug "route=product/search" but it doesn't seem to work. So my question to you guys is as follows: Is it worth trying to fix these errors and do they have an effect on SEO? If so, how do I prevent these errors that seem to grow at every crawl? Cheers, Danny
Search Behavior | | DannyHoodless0 -
Is it better to find a page without the desired content, or not find the page?
Are there any studies that show which is best? If you find my page but not the specific thing you want on it, you may still find something of value. But, if you don't you may associate my site with poor results, which can be worse than finding what you want at a competitor site. IOW maybe it is best to have pages that ONLY and ALWAYS have the content desired. What do the studies suggest? I'm asking because I have content that maybe 1/3 of the time exists and 2/3 of the time doesn't...think 'out of stock' products. So, I'm wondering if I should look into removing the page from being indexed during the 2/3 or should keep it. If I remove it then my concern is whether I lose the history/age factor that I've read Google finds important for credibility. Your thoughts?
Search Behavior | | friendoffood0 -
UK & Ireland Websites displaying same page differently in serps
Hi there, I have a Magento Enterprise store based in the UK and we have an Irish version which we created after finding an increasing amount of traffic from Ireland. One thing that I don't understand, is that if I search for one keyword on Google, the websites are displayed differently, when effectively they are identical websites. Here is how a result looks like for my UK store: http://i.imgur.com/NKSt4Qq.png And here is how a result looks like for my IE store: http://i.imgur.com/Cynv8Mz.png They both have the same Meta description, barring a few geographical words and terms. Both have on page descriptions as well as products. Yet the IE results display the description and the UK results display products and a tiny snippet of the description. Any ideas on how I can make my UK pages display like the IE one? Or, just why they are both displayed differently? Thanks
Search Behavior | | tomhall900 -
Is putting/removing Adsense ads on the site affects crawling for seo?
Because I noticed when we totally remove Adsense ads on our site, the pages crawled per day on the google webmastertools suddenly dropped into noticable amount and we tested again to turn it on for a singe day, it jumped up again. So if Adsense affects crawling then, if we have adsense ad on all pages of the site the more chances it gets crawled by the bot? WS76R8w
Search Behavior | | CruiseControl0 -
Is a Shorter Page Title Better?
Is there any evidence that SEs give a greater weighting to keyword phrases in the page title if there are less characters? For example: 1. "Buy Silver Bullion" 2. "Buy Silver Bullion Coins Bars Rounds Easily Privately Securely" The key phrase I am trying to optimize for is "Buy Silver Bullion." To my knowledge, current practices would say the 2nd phrase is better optimized since it contains more keywords and it has a few USPs. But is there any evidence that the 1st example would be higher ranked in google for the phrase "Buy Silver Bullion" because it is more focused than the 2nd?
Search Behavior | | nwright0 -
Google Is Displaying An Alt image tag as my homepage's page title
Google is randomly displaying the alt image tag as the page title for my homepage. It happens when you search for the brand name, but the page title appears as "BrandName Logo" (obviously not "BrandName"). Has anybody seen this happen before?
Search Behavior | | MichaelWeisbaum0