Why did Google stop indexing my site?
-
Google used to crawl my site every few minutes.
Suddenly it stopped and the last week it indexed 3 pages out of thousands.
What could cause this to happen and how can I solve this problem?
Thanks!
-
It turned out that it was caused by Google Page Speed. They told me that it was fine and nothing to worry about but I just disabled it due to server issues and I guess that is what made the code disappear...
-
Maybe Jill removed it yet at your suggestion
-
it looks like you figured out what that weird code was? I don't see it in the source code anymore.
-
you can fetch google in WMT and googlebot will recrawl
-
I'm sure that you checked yet:
-No important directory is blocked from robots.txt
-The robots.txt detected through Google Webmaster Tools match with the actual file robots.txt (i recently haved a trouble with that)
-New pages are well linked from home
-New pages are in sitemaps.xml with good priority and a dayly update
Share the content imediately with Google plus, it helps!
I cannot be sure, but maybe if Google was much time crawling your site without finding changes, decided to crawl it less frequently
Good Luck!
-
It is indexed but the problem is that most of the indexed pages are outdated and the new ones haven't been crawled.
I would LOVE to know whats up with all of that code. I have been trying to uncover that with no success.... I have no idea where it comes from but also no idea how to find out
-
It's indexed in Google.com
you should geotarget for www.google.co.il
what's up with all of this code that goes on forever in your source
/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ימי הולדת\" href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;small__psa_gt;יום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"בצק סוכר\" href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;בצק סוכר__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"הזמנות ליום הולדת\" href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;הזמנות ליום הולדת__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ברכות ליום הולדת\" href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;small__psa_gt;ברכות ליום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthday-cakes.html\"__psa_gt;__psa_lt;img alt=\"עוגות יום הולדת\" src=\"http://4-ps.googleusercontent.com/x/www.yetzira.com/yetzira.nicole.netdna-cdn.com/xbirthday,P20cake.jpg.pagespeed.ic._Ygk-OCr6B.jpg\" width=\"71\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;img alt=\"יום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/birthday.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;__psa_lt;img title=\"בצק סוכר\" alt=\"בצק סוכר\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/RFM.jpg\" width=\"39\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15858 alignright\" alt=\"הזמנות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/invites.jpg\" width=\"50\" height=\"56\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt; __psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15856 alignright\" alt=\"ברכות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/cards.jpg\" width=\"70\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;/tbody__psa_gt;\n__psa_lt;/table__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;__psa_lt;/h2__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;עיצוב הבית__psa_lt;/h2__psa_gt;\n__psa_lt;table border=\"0\" panel-id=\"panel-id.0\"__psa_gt;\n__psa_lt;tbody__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;small__psa_gt;עיצוב חדרי ילדים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/home.html\"__psa_gt;עיצוב הבית__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/learn-itzuv.html\"__psa_gt;לימודי עיצוב__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/ציורים.html\"__psa_gt;__psa_lt;small__psa_gt;ציורים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;img alt=\"עיצוב חדרי ילדים\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/child-room.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td__psa_gt;__psa
-
My link profile contains natural links only. I have never asked for a link or even exchanged links with anyone.
About 4 years ago my site was hacked and the hackers linked to the content that they inserted in my forum. I have since erased the forum and disavowed the links even though over the years the spammy sites stopped linking to me anyway since their content was removed. This was a long time ago anyway so I don't think it is relevant.
I don't have that many links although the ones I have all linked to me because I have unique content.
My bounce rate has always been around 1%. My users seem to enjoy my content and spend time on my site. My rankings also went down very much since Google stopped crawling. I can't work out why.
-
I have a lot of 404 errors which appear in Google Webmaster Tools but don't appear on my site anymore.
About a month ago I had a problem with Wordpress permalinks and for about 10 hours my posts were crawled under a slightly different URL. During that time many posts were crawled and therefore existed under 2 different URLs. I have since fixed the problem but since Google hasn't really come back to crawl so the errors still appear.
-
Streamline Metrics is correct. Add it to webmaster tools and see what they say. Also, how is your link profile? Any spammy links?
-
Have you claimed the site in Google Webmaster Tools? If not, I suggest doing so at http://www.google.com/webmasters and then you will be able to see if Google has encountered any errors lately and/or you can change the crawl rate if necessary.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google dropping pages from SERPs even though indexed and cached. (Shift over to https suspected.)
Anybody know why pages that have previously been indexed - and that are still present in Google's cache - are now not appearing in Google SERPs? All the usual suspects - noindex, robots, duplication filter, 301s - have been ruled out. We shifted our site over from http to https last week and it appears to have started then, although we have also been playing around with our navigation structure a bit too. Here are a few examples... Example 1: Live URL: https://www.normanrecords.com/records/149002-memory-drawings-there-is-no-perfect-place Cached copy: http://webcache.googleusercontent.com/search?q=cache:https://www.normanrecords.com/records/149002-memory-drawings-there-is-no-perfect-place SERP (1): https://www.google.co.uk/search?q=memory+drawings+there+is+no+perfect+place SERP (2): https://www.google.co.uk/search?q=memory+drawings+there+is+no+perfect+place+site%3Awww.normanrecords.com Example 2: SERP: https://www.google.co.uk/search?q=deaf+center+recount+site%3Awww.normanrecords.com Live URL: https://www.normanrecords.com/records/149001-deaf-center-recount- Cached copy: http://webcache.googleusercontent.com/search?q=cache:https://www.normanrecords.com/records/149001-deaf-center-recount- These are pages that have been linked to from our homepage (Moz PA of 68) prominently for days, are present and correct in our sitemap (https://www.normanrecords.com/catalogue_sitemap.xml), have unique content, have decent on-page optimisation, etc. etc. We moved over to https on 11 Aug. There were some initial wobbles (e.g. 301s from normanrecords.com to www.normanrecords.com got caught up in a nasty loop due to the conflicting 301 from http to https) but these were quickly sorted (i.e. spotted and resolved within minutes). There have been some other changes made to the structure of the site (e.g. a reduction in the navigation options) but nothing I know of that would cause pages to drop like this. For the first example (Memory Drawings) we were ranking on the first page right up until this morning and have been receiving Google traffic for it ever since it was added to the site on 4 Aug. Any help very much appreciated! At the very end of my tether / understanding here... Cheers, Nathon
Technical SEO | | nathonraine0 -
Can't get Google to Index .pdf in wp-content folder
We created an indepth case study/survey for a legal client and can't get Google to crawl the PDF which is hosted on Wordpress in the wp-content folder. It is linked to heavily from nearly all pages of the site by a global sidebar. Am I missing something obvious as to why Google won't crawl this PDF? We can't get much value from it unless it gets indexed. Any help is greatly appreciated. Thanks! Here is the PDF itself:
Technical SEO | | inboundauthority
http://www.billbonebikelaw.com/wp-content/uploads/2013/11/Whitepaper-Drivers-vs-cyclists-Floridas-Struggle-to-share-the-road.pdf Here is the page it is linked from:
http://www.billbonebikelaw.com/resources/drivers-vs-cyclists-study/0 -
Google not indexing my website
Hi guys, We have this website http://www.m-health-expo.nl/ but it is not indexed by google. In webmaster tools google says that it can not fetch the site due to the robots.txt but i do not see any faults in it. http://www.m-health-expo.nl/robots.txt Do you see something strange, it really bothers me.
Technical SEO | | RuudHeijnen0 -
Do Com Junct links affect your site with Google and Penguin
We received the dreaded letter from google in reference to "unnatural or artificial links" Our site has affiliate programs through Commission Junction and Link Share and between the two programs we have over 8000 affiliates or advertisers. Our site has been very successful, but our organic search traffic is down as our rankings in the search engines have dropped. My question is do the affiliate links have an effect on our site with Panda or Penguin?
Technical SEO | | Statrak0 -
Searching in Google using the Site:www.example.com specification - is it in an order?
Hi Gurus, Just a quick searching question. If you do a Google search using the site: specification eg. site:www.example.com Is the list returned by Google in an order of something similar to 'Page Authority' or some other order eg. page first seen date etc. Because you are looking at your single site, is Google listing your pages back to you in it's perceived order of current 'popularity'? Thanks, Brad
Technical SEO | | BM70 -
How do you know what version of your site of Google is in their index?
This is going to sound like a strange question, but I am trying to understand which version of our site is in the index. You might think this is an obvious question, but here is why I am asking: 1. Today I searched for a specific keyword and found the listing. 2. I liked on the right arrow next to the listing and checked the cache date. It says 6/28 and shows the site as of 6/28. 3. I expected to see that we were just indexed as we jumped several pages since yesterday and I had just checked two days ago and we hadn't moved at all. It seems like Google may have taken the changes we made on 7/2 but since it is showing 6/28, I am note sure. Since this is confusing, here is the chronology: 1. Made changes 6/20. 2. Site appeared to be indexed on 6/28. 3. Made changes on 7/2. 4. Checked the site on 7/2 and we were in position 60. Checked the site on 7/4 and we were in position 61. 5.. Checked the site today (7/6) and see we are in position 8. The cache date shows as 6/28. I suspect that Google just indexed us yesterday and is reflecting the changes I made on 7/2. But the fact that it says it was cached on 6/28 seems to sugges otherwise. I want to be sure I know which version got us the good rankings - is there any way to be sure? Thanks!!
Technical SEO | | trophycentraltrophiesandawards0 -
Have I Set my joomla site map correctly as google not picking up articles
Hi here is my site map http://www.in2town.co.uk/sitemap-xml?sitemap=1 But i am concerned that i have not set my joomla site map correctly. The reason why i think this is, because i have a lot of articles on the site and google are not picking them up in my google webmaster tools. On my old site google was quick to pick up all the articles. Can anyone offer me any help on this and let me know if my site map should be set to show all of my articles
Technical SEO | | ClaireH-1848860 -
Site not being Indexed that fast anymore, Is something wrong with this Robots.txt
My wordpress site's robots.txt used to be this: User-agent: * Disallow: Sitemap: http://www.domainame.com/sitemap.xml.gz I also have all in one SEO installed and other than posts, tags are also index,follow on my site. My new posts used to appear on google in seconds after publishing. I changed the robots.txt to following and now post indexing takes hours. Is there something wrong with this robots.txt? User-agent: * Disallow: /cgi-bin Disallow: /wp-admin Disallow: /wp-includes Disallow: /wp-content/plugins Disallow: /wp-content/cache Disallow: /wp-content/themes Disallow: /wp-login.php Disallow: /wp-login.php Disallow: /trackback Disallow: /feed Disallow: /comments Disallow: /author Disallow: /category Disallow: */trackback Disallow: */feed Disallow: */comments Disallow: /login/ Disallow: /wget/ Disallow: /httpd/ Disallow: /*.php$ Disallow: /? Disallow: /*.js$ Disallow: /*.inc$ Disallow: /*.css$ Disallow: /*.gz$ Disallow: /*.wmv$ Disallow: /*.cgi$ Disallow: /*.xhtml$ Disallow: /? Disallow: /*?Allow: /wp-content/uploads User-agent: TechnoratiBot/8.1 Disallow: ia_archiverUser-agent: ia_archiver Disallow: / disable duggmirror User-agent: duggmirror Disallow: / allow google image bot to search all imagesUser-agent: Googlebot-Image Disallow: /wp-includes/ Allow: /* # allow adsense bot on entire siteUser-agent: Mediapartners-Google* Disallow: Allow: /* Sitemap: http://www.domainname.com/sitemap.xml.gz
Technical SEO | | ideas1230