How to Index Faster?
-
Hello,
I have a new website and updated fresh content regularly. My indexing status is very slow.
When I search how to improve my indexing rate by Google, I found most of the members of Moz community replied there is no certain technique to improve your indexing. Apart from this you should keep posting fresh content more and more and wait for Google Indexing.
Some of them asked for submitting sitemap and share posts on Twitter, Facebook and Google Plus.
Well the above comments are from the year of 2012.
I'm curious to know is there any new technique or methods are used to improve indexing rate?
Need your suggestions!
Thanks.
-
As mentioned earlier, you can create a comprehensive Sitemap.xml file and resubmit to Google. Give me your email address, I will create one for you and send it
Best regards,
Devanur Rafi
-
The site has about 140 articles as of now. So there are 140 post URLs. This apart, there are many category, tags, author pages. So the number should be 230 URLs as indicated by Google. However, Google may show only post pages no a priority. This is just my hunch. Thanks,
-
Nevermind, there are about 497 pages on your website. So, I would ask you to use a comprehensive sitemap.xml file and submit it to Google. You can use a tool like GSite crawler to generate one.
-
Thanks for your help, Kavit
the website's URL is www.getyourtips.com
As per the results shown by PageSpeed test on Google, the website scores 69 out of 100 on mobile devices and 79 out of 100 on desktop PCs.
https://www.dropbox.com/s/xmfw6zci8hih3sn/Screenshot 2014-06-10 14.48.09.png
While there's still room for improvement, I think the scores aren't that bad at the moment? Please, take a look at the site and let me know if I could change some properties to make it load even faster.
This is a brand new website (just 2 month old) and it might take a while to establish authority or get some PageRank. Considering these, what should be the best foot forward?
Thanks,
-
Thanks for the info Susanta. After a quick check, I see the sitemap.xml that you submitted has only 130 URLs in it and there are 230 pages (omitted after 182) indexed in Google from your website. So, can you tell me how many pages are there in total in your website?
-
Hi Devanur,
Thanks for the help! Here's the URL of my website www.getyourtips.com
Here's a screenshot of the index status of the website on GWT: https://www.dropbox.com/s/nyrwjvvmt0novu7/Screenshot 2014-06-10 14.32.12.png
Here's a screenshot of the search queries page: https://www.dropbox.com/s/2js1oqtrtseg56g/Screenshot 2014-06-10 14.38.30.png
The website is a little over 2 months old.
We have submitted the Sitemap already.
We used to post 4 posts per day during the launch of the website but we have reduced the posting to just one per day since last week.
Would like to know if there is anything more we should do apart from submitting sites to different blog feeds to get the index more frequently.
Thanks,
-
Hi Susanta,
If I was you, I would focus on site performance. Having a fast responsive site means you can expose more of your site & contents to Google during each crawl.
If you have all this great content, it might be a matter of making the site faster so that Google can index more each time.
Crawl rates and indexation are largely affected by your PageRank and Authority with Google so this does get better with time as your site improves in these areas.
-
Hi Susanta,
If you can share the URL of your domain, we will be able to answer better as the rate of indexing differs from site to site and also depends on lot of things like the website internal linking structure, website architecture, your backlinks and the list goes on..
Sitemap.xml is definitely a good way to give the indexing rate of your website a boost. But the story does not end there as there are lot of things that come in to play.
Best regards,
Devanur Rafi
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
E-Commerce Site Collection Pages Not Being Indexed
Hello Everyone, So this is not really my strong suit but I’m going to do my best to explain the full scope of the issue and really hope someone has any insight. We have an e-commerce client (can't really share the domain) that uses Shopify; they have a large number of products categorized by Collections. The issue is when we do a site:search of our Collection Pages (site:Domain.com/Collections/) they don’t seem to be indexed. Also, not sure if it’s relevant but we also recently did an over-hall of our design. Because we haven’t been able to identify the issue here’s everything we know/have done so far: Moz Crawl Check and the Collection Pages came up. Checked Organic Landing Page Analytics (source/medium: Google) and the pages are getting traffic. Submitted the pages to Google Search Console. The URLs are listed on the sitemap.xml but when we tried to submit the Collections sitemap.xml to Google Search Console 99 were submitted but nothing came back as being indexed (like our other pages and products). We tested the URL in GSC’s robots.txt tester and it came up as being “allowed” but just in case below is the language used in our robots:
Intermediate & Advanced SEO | | Ben-R
User-agent: *
Disallow: /admin
Disallow: /cart
Disallow: /orders
Disallow: /checkout
Disallow: /9545580/checkouts
Disallow: /carts
Disallow: /account
Disallow: /collections/+
Disallow: /collections/%2B
Disallow: /collections/%2b
Disallow: /blogs/+
Disallow: /blogs/%2B
Disallow: /blogs/%2b
Disallow: /design_theme_id
Disallow: /preview_theme_id
Disallow: /preview_script_id
Disallow: /apple-app-site-association
Sitemap: https://domain.com/sitemap.xml A Google Cache:Search currently shows a collections/all page we have up that lists all of our products. Please let us know if there’s any other details we could provide that might help. Any insight or suggestions would be very much appreciated. Looking forward to hearing all of your thoughts! Thank you in advance. Best,0 -
Trouble Indexing one of our sitemaps
Hi everyone thanks for your help. Any feedback is appreciated. We have three separate sitemaps: blog/sitemap.xml events.xml sitemap.xml Unfortunately we keep trying to get our events sitemap to pickup and it just isn't happening for us. Any input on what could be going on?
Intermediate & Advanced SEO | | TicketCity0 -
Index Pages become No-Index
Hi Mozzers, Here is the scenario: I created a landing page targeting Holiday keywords for the holiday season. The page has been crawled and indexed - I see my landing page in the SERP. However, because of the CMS layout, since the Holiday is over and I don't want it to be displayed on the homepage, i have to remove the page from hp which makes it no-index (don't ask why, it's how the CMS was built). Question: How does this affect this LP's search? Since it's already crawled and etc. will it still be on the SERP after i change the page to no-index? If I remove the no-index next year for the holiday season, how does this all play out? Any insights or information provided will be appreciated. Thank you!
Intermediate & Advanced SEO | | TommyTan0 -
Language Subdirectory homepage not indexed by Google
Hi mozzers, Our Spanish homepage doesn't seem to be indexed or cached in Google, despite being online for over a month or two. All Spanish subpages are indexed and have started to rank but not the homepage. I have submitted sitemap xml to GWTools and have checked there's no noindex on the page - it seems to be in order. And when I run site: command in Google it shows all pages except homepage. What could be the problem? Here's the page: http://www.bosphorusyacht.com/es/
Intermediate & Advanced SEO | | emerald0 -
Certain Product Pages Not Indexing
Hey All, We discovered an issue where new product pages on our site were not getting indexed because a "noindex" tag was inadvertently being added to section when those pages were created. We removed the noindex tag in late April and some of the pages that had not been previously indexed are now showing up, but others are still not getting indexed and I'd appreciate some help on why this could be. Here is an example of a page that was not in the index but is now showing after removal of noindex: http://www.cloud9living.com/san-diego/gaslamp-quarter-food-tour And here is an example of a page that is still not showing in the index: http://www.cloud9living.com/atlanta/race-a-ferrari UPDATE: The above page is now showing after I manually submitted it in WMT. I had previously submitted another page like a month ago and it was still not indexing so I thought the manual submission was a dead end. However, it just so happens that the above URL just had its Page Title and H1 updated to something more specific and less duplicative so I am currently running a test to see if that's the problem with these pages not indexing. Will update this soon. Any suggestions? Thanks!
Intermediate & Advanced SEO | | GManSEO0 -
Huge Google index on E-commerce site
Hi Guys, I got a question which i can't understand. I'm working on a e-commerce site which recently got a CMS update including URL updates.
Intermediate & Advanced SEO | | ssiebn7
We did a lot of 301's on the old url's (around 3000 /4000 i guess) and submitted a new sitemap (around 12.000 urls, of which 10.500 are indexed). The strange thing is.. When i check the indexing status in webmaster tools Google tells me there are over 98.000 url's indexed.
Doing the site:domainx.com Google tells me there are 111.000 url's indexed. Another strange thing which another forum member describes here : Cache date has been reverted And next to that old url's (which have a 301 for about a month now) keep showing up in the index. Does anyone know what i could do to solve the problem?0 -
Redirect index.php to domain address
The question says it all really. Google analytics shows me that my top 2 pages are my domain address and index.php, which are exactly the same. Is it best to leave it like this or redirect index.php to my domain address?
Intermediate & Advanced SEO | | CompleteOffice0 -
Should you stop indexing of short lived pages?
In my site there will be a lot of pages that have a short life span of about a week as they are items on sale, should I nofollow the links meaning the site has a fwe hundred pages or allow indexing and have thousands but then have lots of links to pages that do not exist. I would of course if allowing indexing make sure the page links does not error and sends them to a similarly relevant page but which is best for me with the SEarch Engines? I would like to have the option of loads of links with pages of loads of content but not if it is detrimental Thanks
Intermediate & Advanced SEO | | barney30120