How long does it take for an article or a page to be listed by google
-
Hi, my question is a two parter. I think i must be doing something wrong.
With my site map, it is set to show different section of my site while on my old site the site map listed every single article - i am not sure if setting it to each section is correct, can someone please advise me on this.
The second part of the question is, how long does it take for an article to be listed by google.
This article on my site was written today http://www.in2town.co.uk/lifestyle/holidaymakers-ignore-the-importance-of-travel-insurance-according-to-survey
Holidaymakers Ignore The Importance of Travel Insurance According To Survey
but when i check to see if google has listed the article yet by putting in the whole title, it does not come up, i even added the website name at the end and still it did not come up.
This is worrying me a bit as a lot of my articles are news stories which means they are current articles so if google is not picking them up then no one else will be.
can anyone let me know what i should be doing so google picks them up quicker please.
-
If you add new conetnt every day, you will start to get crawled every day.
-
the huge problem i have is getting the news pages picked up straight away, this has been a big headache of mine. there is no point in a news page being read in two days when it is old news.
I need to find a way to promote the latest news on my site and get it picked up by google
-
Bing's duane forrester said that you should not list every page, but the imporatant pages, but when i asked him about this he said that for a small site it is ok to list every page.
A site maop does not mean that your the pages it luist will be indexed, nor does it mean pages that are not included wont be indexed. It is a chance to giove the SE some info about the pages. liek change freqency, last modified, priority and such. It is also a signal of the canonical version of a page.
It is also worth noting that Bing will ignore a sitemap if it is not honest, if you put updated daily but dont do so, they will lose trust in it.
As for how long it takles to get listed, anywhere up to a month in most cases. In bing webmster tools you can place it directly into the index and will be in results shoprtly after, you can do the same in GWMT but using the instant previews or fetch as googlebot (I cant rember which) I have been told.
-
I'm not a Joomla expert - so you're best bet is to check with someone who is, however there are Joomla extensions you can use to automate the generation of your sitemap so you don't have to manually do it every time.
Which one you use is something I'm not prepared to recommend because I am not up to speed enough on Joomla.
-
hi alan, this is great. can you explain more. i use joomla, so not sure how to really set the site map.
this is the site map i am using
http://www.in2town.co.uk/sitemap-xml?sitemap=1
can you explain what i need to do to make sure that all articles are included and should i put the sitemap on my site or leave it in googlewebmaster
-
Diane,
a sitemap.xml file should include links to every page on the site you want indexed. While Google and Bing are fairly good at discovering content, this helps ensure they find pages sooner than their crawler might get around to discovering them. (unless you have a site with more than 10,000 URLS - at which point you should consider splitting sitemap files into multiple files and including a separate sitemap index file that you then submit. )
That then leads to the next question - how often? Every site is different and crawled at a different frequency based on Google's assessment of how often it should happen as well as factoring in that their system can only crawl so many pages on any given day.
That alone is reason to include all your content in sitemap files - and automatically ping search engines each time the sitemap file is updated.
If you have enough "news quality" content, look into a separate news sitemap file as well. With the right footwork and leverage, you can then see if your news specific content can be indexed even faster, and included in the Google news system as well.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our protected pages 302 redirect to a login page if not a member. Is that a problem for SEO?
We have a membership site that has links out in our unprotected pages. If a non-member clicks on these links it sends a 302 redirect to the login / join page. Is this an issue for SEO? Thanks!
Technical SEO | | rimix1 -
Google displays multiple titles for same article. What does this mean?
I've linked to some screenshots so that it what I'm talking about makes more sense. Sometimes, when I perform a search, I see an article with the correct article title listed as the page title in the SERPs. Other times, I see the wrong page title – it's a generic somethin' or other done by my client's web design company with a bunch of keywords thrown in. The latter (not the correct article title) also appears at the top of the browser tab for every article on my client's site. I know this is bad, but what can be done about it? This would never happen if my client used Wordpress or some easily modifiable CMS, but they're using a proprietary one maintained by the group that designed the website. open?id=0BxB_dYL1ylGgVVF1dHlwdXp2dFU open?id=0BxB_dYL1ylGgdWJjdlJoRlRIR00
Technical SEO | | Greenery0 -
Duplicate content on Places to Stay listings pages
Hello, I've just crawled our website https://www.i-escape.com/ to find we have a duplicate content issue. Every places to stay listing page has identical content (over 1,500 places) due to the fact it's based on user searches or selections. If we hide this pages using canonical tags, will we lose our visibility for each country and/or region we promote hotels? Any help on this would be hugely appreciated! Thanks so much Clair
Technical SEO | | iescape0 -
Will a Robots.txt 'disallow' of a directory, keep Google from seeing 301 redirects for pages/files within the directory?
Hi- I have a client that had thousands of dynamic php pages indexed by Google that shouldn't have been. He has since blocked these php pages via robots.txt disallow. Unfortunately, many of those php pages were linked to by high quality sites mulitiple times (instead of the static urls) before he put up the php 'disallow'. If we create 301 redirects for some of these php URLs that area still showing high value backlinks and send them to the correct static URLs, will Google even see these 301 redirects and pass link value to the proper static URLs? Or will the robots.txt keep Google away and we lose all these high quality backlinks? I guess the same question applies if we use the canonical tag instead of the 301. Will the robots.txt keep Google from seeing the canonical tags on the php pages? Thanks very much, V
Technical SEO | | Voodak0 -
How Does Google's "index" find the location of pages in the "page directory" to return?
This is my understanding of how Google's search works, and I am unsure about one thing in specific: Google continuously crawls websites and stores each page it finds (let's call it "page directory") Google's "page directory" is a cache so it isn't the "live" version of the page Google has separate storage called "the index" which contains all the keywords searched. These keywords in "the index" point to the pages in the "page directory" that contain the same keywords. When someone searches a keyword, that keyword is accessed in the "index" and returns all relevant pages in the "page directory" These returned pages are given ranks based on the algorithm The one part I'm unsure of is how Google's "index" knows the location of relevant pages in the "page directory". The keyword entries in the "index" point to the "page directory" somehow. I'm thinking each page has a url in the "page directory", and the entries in the "index" contain these urls. Since Google's "page directory" is a cache, would the urls be the same as the live website (and would the keywords in the "index" point to these urls)? For example if webpage is found at wwww.website.com/page1, would the "page directory" store this page under that url in Google's cache? The reason I want to discuss this is to know the effects of changing a pages url by understanding how the search process works better.
Technical SEO | | reidsteven750 -
Roger bot taking a long time to crawl site
Hi all, I've noticed Roger bot is taking a long time to crawl my new site. It started on the 28th Feb 2013 and is still going. There aren't many pages at the moment. Any ideas please? thanks a lot, Mark.
Technical SEO | | caterfor1 -
How do I keep Google from crawling my PPC landing page?
Question, I don't want Google to catch my PPC landing pages, but I'm wondering if I make the page no-follow, no-index will it still crawl my landing page for quality score? Just to clarify I do want it to crawl the landing page to boost my quality score on PPC, but I do not want it to index it for SEO. Thanks 🙂
Technical SEO | | jhinchcliffe0 -
How long will Google take to stop crawling an old URL once it has been 301 redirected
I need to do a clean-up old urls that have been redirected in sitemap and was wondering about this.
Technical SEO | | Ant-8080