Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Index Issue - Indexing pages that don't exhist
Hi All, I have noticed a weird issue when performing a search on Google to show me all the pages it is indexing of our site. site:www.one2create.co.uk It brings up most of our website pages but then is also brings up a few HTTPS urls (our site has not been converted to HTTPS yet) but also the URL path, Title, and Meta Description are from one of our clients websites (an Automotive Job site). When clicked they take you to a generic 404 server error page, not our branded 404 page. The site that it has taken the url, title and meta description from is on a different server completely so I don't see how it has even managed to get that information and linked it to our site? Has anyone seen anything like this before? And what is the best way to fix it? We have asked Google to re-index the site but still no luck.
Search Behavior | | Jvickery0 -
Bounce Rate: Would GA consider a user interacting with a single page (i.e expanding text), before exiting a bounce?
Hey guys, I have done a ton of research regarding bounce rates, yet I cannot seem to find the answer I'm after. Senario: BoIf a user follows a link and lands on a product results page with various sets of filters and an "apply" button, looks through the site, adjusts the filter functions (without changing the url structure) and exists without going to another page - would that qualify as a bounce in Google Analytics? For example: If I click 'details' to see expandable text on a results page ( /credit-cards). The dynamic url I'm talking about is below: https://masii.co.th/thai-en/credit-card/compare-buy?category=shopping%2Ccashback%2Cair_miles%2Cassistance%2Cdining%2Cpetrol%2Crewards&income=30000
Search Behavior | | Masii0 -
Help Me With These Horrible Crawl Errors
I am currently using Opencart to run a fairly popular ecommerce website. I have done quite well in terms of rankings so far. However, the Opencart platform only goes so far. There are endless amounts of crawl errors, from duplicate content down to missing meta tags. There is no easy way to add canonical tags. The pages that are being listed in the crawl errors seem to be mainly search URL's that i have no idea how Moz found them. An example of the page is: .....com/index.php?route=product/search&tag=home+office+flooring Which has ten duplicate pages all missing meta tags. I have used Google webmaster tools and htaccess to deny access to these pages with the slug "route=product/search" but it doesn't seem to work. So my question to you guys is as follows: Is it worth trying to fix these errors and do they have an effect on SEO? If so, how do I prevent these errors that seem to grow at every crawl? Cheers, Danny
Search Behavior | | DannyHoodless0 -
Long list or paginated pages
Hi peeps, I am just interested in this from a usability POV and to see what you would prefer to see when you are met with a page that has multiple options. Lets say that the page looks like a list of services, each clearly marked out in its own segment, but there are 50-60 options that match your requirements. Do you like to keep scrolling, or would you prefer to take what is there and then move on if you feel you want to dig deeper? Would you like to see a long list, of have the options loaded in as you get to them? -Andy
Search Behavior | | Andy.Drinkwater2 -
Google site: search showing twice amount of indexed pages. why?
I have around 50k pages indexed on my site but when I do a google site: of my site it shows around 100k pages indexed. Why is it showing so much more? It is also only showing around 700 pages indexed in my web masters account for the site. Background: We have a custom site map being generated automatically. Let me know if you would like more info, Thanks.
Search Behavior | | Nicktaylor10 -
Creation of Landing Pages. Subdomain or something else?
Hi, I have an issue deciding how my landing pages should be like and I would like to ask for your help. Currently my landing pages are configured and presented like this: http://www.example.com/fra/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= I would like to know if making a subdomain landing page is advised, maybe something like this: http://LandingPage.example.com/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= Or if you suggest doing something else with my landing pages - I would like to know that as well. p.s. - How I tell the webmasters (my affiliates) to make a clickable button that won't be a direct link to my landing page but will be some form of non-visible redirect? Thanks in advance 🙂
Search Behavior | | JonsonSwartz0 -
Home page (s) deindexed
Ok odd one. 2 sites hosted on go daddy, neither sites has any cause for concern. But both sites have had there home pages deindexed or - 10000 penalty for no reason. We do the SEO for 1 site and not for the other. The server is shared with go daddy no idea on how many other 3rd party sites are on it. I've filed a reinclusion request for both sites. Any help is more than welcome.
Search Behavior | | therealmarkhall0 -
Google Is Displaying An Alt image tag as my homepage's page title
Google is randomly displaying the alt image tag as the page title for my homepage. It happens when you search for the brand name, but the page title appears as "BrandName Logo" (obviously not "BrandName"). Has anybody seen this happen before?
Search Behavior | | MichaelWeisbaum0