Time taken for inclusion in index
-
After a page is crawled, how much time does it take to be included in Google's index ? Immediately ? after few days ?
-
I recall seeing a question you asked about Google + a day or so ago, but I did not know the answer to it. Sorry.
I would suggest you at least provide a link to the question otherwise no one will find it.
-
Thanks again for a very detailed clarification. I wish someone answers my question about Google plus button too.
-
There is not any published standard on how frequently Google will discover new content on your site. There are too many factors ranging from your DA (which is not actually a Google metric), how deep the page is in your site, how well linked the page is both internally and externally, etc.
It could be that Google was planning to visit your site, you post an article, and they find it right away. It could also happen then Google just left your site, you post an article and they may not find it for a week or more.
The normal rules of SEO apply. If your article is important then either add a snippet to your landing page or at least link directly to it from your landing page. Work immediately to earn links to the article, tweet it, etc. Send Google an updated sitemap with a link to the article. All of these activities can indicate to Google your content is important and should be indexed.
-
I missed the last point. That's what i would like to know. I mean for a normal website, there must be some time delay in crawling and indexing. Not every site has a DA of 87 !
-
I find it strange that one of my question about Google plus button is unanswered. I hope someone answers it.
-
Thanks Ryan for your quick response.
-
Thanks Ryan for your quick response.
-
When Google crawls a page it is immediately added to the index, assuming they decide to index the page.
Want proof? When I look at this Q&A I see "Posted by Atul Sharma about 1 hour ago". When I search Google for this Q&A title I find this result.
Keep in mind SEOmoz has a DA of 87 which is why Google crawls this site so frequently.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Removing non www and index.php
Hi, I'm green when it comes to altering the htaccess file to remove non www and index.php. I think I've managed to redirect the urls to www however not sure if I've managed to remove the index.php. I'm pasting the contents of the htaccess file here maybe someone can identify if I have unwanted lines of code and if it is up to standard (there are a lot of comments in #) not sure if needed but I've left them as I don't want to screw up anything. Thanks 🙂 @package Joomla @copyright Copyright (C) 2005 - 2016 Open Source Matters. All rights reserved. @license GNU General Public License version 2 or later; see LICENSE.txt READ THIS COMPLETELY IF YOU CHOOSE TO USE THIS FILE! The line 'Options +FollowSymLinks' may cause problems with some server configurations. It is required for the use of mod_rewrite, but it may have already been set by your server administrator in a way that disallows changing it in this .htaccess file. If using it causes your site to produce an error, comment it out (add # to the beginning of the line), reload your site in your browser and test your sef urls. If they work, then it has been set by your server administrator and you do not need to set it here. No directory listings IndexIgnore * Can be commented out if causes errors, see notes above. Options +FollowSymlinks
On-Page Optimization | | KeithBugeja
Options -Indexes Mod_rewrite in use. RewriteEngine On
RewriteCond %{REQUEST_URI} ^/index.php/
RewriteRule ^index.php/(.*) /$1 [R,L] Begin - Rewrite rules to block out some common exploits. If you experience problems on your site then comment out the operations listed below by adding a # to the beginning of the line. This attempts to block the most common type of exploit attempts on Joomla! Block any script trying to base64_encode data within the URL. RewriteCond %{QUERY_STRING} base64_encode[^(]([^)]) [OR] Block any script that includes a0 -
Single Page on my client's website is not crawling and indexing new changes. What could be the possible reason?
I made several changes on client's website on different pages, changed titles, add content on few pages, moved blog from subdomain to sub directory. Everything is crawled but there is one page on the website (not part of the blog) that isn't getting crawled in Google and picking up changes. The last crawl of the website is 2 days back whereas that page was last crawled on 30th sep. I just wanted to know the possible reasons and has anyone encountered this before?
On-Page Optimization | | MoosaHemani0 -
Links in my website are indexed as separate pages
Hi All, We have pages which has names of people which we have created a Alink when clicked it goes to the related persons name. Now Google has indexed it as a seperate page example www.xyz.com/person/name www.xyz.com/person/name?alinks Now the same page is seen in google 2 times. How can i handle this please
On-Page Optimization | | jomin740 -
Does Widgetised Content Index The Same As A Regular Page
Hi, We have a website that was built in my opinion bizarrely where the bottom half of the page where most of the content is, is a widget. I just wondered if the content being in a widget is indexed any differently. I ask as normal pages seem to index and rank much better than the wordpress template using the widget. Hope someone might be able to clarify this. Thanks
On-Page Optimization | | denismilton0 -
Pages indexed but not seen in wordpress
Hi there, the crawler of SEOMOZ has detected that some pages have no title or a short metadescription. The problem is that I can't see these pages in wordpress (in the backend). These pages are irrelevant and must be deleted but I can't find them. How could they be indexed by the Googlebot? Where can I find them? Any hint? Thanks all.
On-Page Optimization | | juanmiguelcr0 -
When to not index
We are working on a brand new site http://www.shedfinders.com/ The site has some login sections i.e. agent profiles for property agents etc, register etc. I figured what is the harm to submit all of these in sitemap and use Yoast to ensure on page is as good as it can be. If a user stumbles across any then they would be redirected back to a a register/login page. Not sure what is best practice? Laura
On-Page Optimization | | lauratagdigital0 -
Index.php + external site added to end of URL
Good day, I have a domain http://www.ecofriendlylink.com. I am trying to resolve the Crawl Diagnostic errors on it. I have several Duplicate Page Content errors. Example 1: (The domain happynewyou is not mine, some Comments from them have been placed on my site. Ecoshop.php is a page on my site). URL: http://www.ecofriendlylink.com Duplicate Page Content: http://www.ecofriendlylink.com/www./happynewyou.com/ecoshop.php Referrer: None. Example 2: URL: http://ecofriendlylink.com/index.php Duplicate Page Content: http://www.ecofriendlylink.com/index.php http://www.ecofriendlylink.com/www./happynewyou.com/index.php Referrer: http://ecofriendlylink.com/ Example 3: is a different problem, but still a Dup Page Error. URL: http://ecofriendlylink.com/water.php Duplicate Page Content: http://www.ecofriendlylink.com/water.php Referrer: http://ecofriendlylink.com/ water.php is a page on my main domain. The www version and the non-www version, if this a problem and something I need to overcome? So please can you advise what I need to do to get rid of this strange external domain name + index.php (as per examples 1 + 2), and explain what I'm doing wrong with Ex 3. Thank you!
On-Page Optimization | | drkevinhogan0 -
Does Frequency of content updates affect likelyhood outbound links will be indexed?
I have several pages on our website with low pr, that also themselves link to lots and lots of pages that are service/product specific. Since there are so many outbound links, I know that the small amount of PR will be spread thin as it is. My question is, if I were to supply fresh content to the top level pages, and change it often, would that influence whether or not google indexes the underlying pages? Also if I supply fresh content to the underlying pages, once google crawls them, would that guarantee that google considers them 'important' enough to be indexed" I guess my real question is, can freshness of content and frequency of update convince google that the underlying pages are 'worthy of being indexed', and can producing fresh content on those pages 'keep google's interest', so to speak, despite having little if any pagerank.
On-Page Optimization | | ilyaelbert0