Only 11 pages being crawled
-
Hi,
Can some one have a look and see why out of 400+ pages we only have 11 being crawled on here??
http://www.lifetimelegal.co.uk
Kind Regards
Elissa
-
When I search your site in Google it shows me 82 results against my query “site:domain.com” so it seems like Google is slowly crawling your site but you are right the rate of crawling pages is quite slow and to increase this here are few things that you should follow
- Strong Internal Linking
It is important to have a strong internal linking between the pages if you want Google and other search engine to crawl your page. Please check if you have a strong and powerful internal linking between the pages
- Xml Sitemap
The other thing that is missing on your site is xml sitemap. The idea is to add an xml sitemap and add it in Google webmaster tool and this will indicate Google to crawl different areas of your website with no hassle
Hope this will help!
-
Just looking around your site, the code seems ok - to a large extent.
But you are missing a sitemap (handy to point to all urls) and a robots.txt file
Also just clicking around i don't see 400 pages? is there a subdomain or folder you aren't linking to from the main site?
-
Hi Elisa,
It looks like it's pretty simple, when I crawl your Web site with Screaming Frog I only found 11 pages too. The reason is that the other pages aren't linked from the 11 pages found during a crawl. I would recommend to link to your other pages as well so these pages are found.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Location Pages
Hi. A client of mine offers multiple services and covers a region of the UK. They want to target each major town/city within this area. However, there are 20 cities and services offered range from 5-15 services. I am in the process of creating a location page for each city, so it can be optimised separately however I am not sure if there is a better way to do it? Or should I create a page for each city & service. So I for example I end up with 10 London pages with each one offering a different service? These can all be optimised for different services within London then? Any suggestions? Thanks
Search Behavior | | YNWA0 -
Decent Bounce Rate but extremely low visit duration and page depth?
I'm having a bit of difficulty understanding the Bounce Rate, Visit Duration, and Page Depth metrics in Google Analytics. GA is reporting that my site's bounce rate is pretty decent - currently 36%. Yet when I drill down into audience behavior engagement, I am seeing that the vast majority of visit durations are 0-10 seconds, and the page depth is only 1 for a majority of visitors. If this were the case, wouldn't my bounce rate be higher?
Search Behavior | | JPS890 -
Page ranking in .com but not in .co.uk
Hi there, I tried to search the Q&A but couldn't find any answers to my issue. We have a page that is ranking #2 for the term "translation memory" in google.com, but it doesn't show in Google.co.uk. This has been like this for weeks now. We are not targeting any specific country in GWT. Does anyone know a possible explanation for this? Thank you.
Search Behavior | | SDLOnlineChannel0 -
Creation of Landing Pages. Subdomain or something else?
Hi, I have an issue deciding how my landing pages should be like and I would like to ask for your help. Currently my landing pages are configured and presented like this: http://www.example.com/fra/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= I would like to know if making a subdomain landing page is advised, maybe something like this: http://LandingPage.example.com/Landing75.php?t_src=example&t=AFF&t_cre=keyboard-price&t_trm=160o600&B=1496&A=371&TargetURL= Or if you suggest doing something else with my landing pages - I would like to know that as well. p.s. - How I tell the webmasters (my affiliates) to make a clickable button that won't be a direct link to my landing page but will be some form of non-visible redirect? Thanks in advance 🙂
Search Behavior | | JonsonSwartz0 -
How come some local 7 pack listings link to site and some link to the G+ page?
Does anyone know how to fix this issue? Even though a site profile has had the website added to it Google continues to link the main "title tag" link to the G+ page and not the actual website domain. Thanks for any info in advance! https://www.google.com/#sclient=psy-ab&q=dog+sitting+in+rockaway&oq=dog+sitting+in+rockaway&gs_l=hp.3..0i22i30l4.14871.16189.1.16397.8.8.0.0.0.0.296.2042.2-7.7.0...0.0...1c.1.15.psy-ab.Y1db0jo77V0&pbx=1&bav=on.2,or.r_cp.r_qf.&bvm=bv.47244034,d.bmk&fp=722b460c2153b7be&biw=1920&bih=910
Search Behavior | | irvingw0 -
Is putting/removing Adsense ads on the site affects crawling for seo?
Because I noticed when we totally remove Adsense ads on our site, the pages crawled per day on the google webmastertools suddenly dropped into noticable amount and we tested again to turn it on for a singe day, it jumped up again. So if Adsense affects crawling then, if we have adsense ad on all pages of the site the more chances it gets crawled by the bot? WS76R8w
Search Behavior | | CruiseControl0 -
Is it possible to know if visitor arrived at the web page via organic search and if so, show some content?
Hello, Is it possible to know if visitors are arriving at a web page via organic search? Background: We have a section of job description pages to explain typical tasks. These have very high bounce rate (some 100%), and I think people are confusing them with actual jobs. For example "stage designer". Many of those keyword we have very high rankings. I am thinking of having a small notice at the top of those page to say something like "if you are stage designer job, check out our job section". Thanks
Search Behavior | | CreativeChoices0 -
Is a Shorter Page Title Better?
Is there any evidence that SEs give a greater weighting to keyword phrases in the page title if there are less characters? For example: 1. "Buy Silver Bullion" 2. "Buy Silver Bullion Coins Bars Rounds Easily Privately Securely" The key phrase I am trying to optimize for is "Buy Silver Bullion." To my knowledge, current practices would say the 2nd phrase is better optimized since it contains more keywords and it has a few USPs. But is there any evidence that the 1st example would be higher ranked in google for the phrase "Buy Silver Bullion" because it is more focused than the 2nd?
Search Behavior | | nwright0