Why did Google stop indexing my site?
-
Google used to crawl my site every few minutes.
Suddenly it stopped and the last week it indexed 3 pages out of thousands.
What could cause this to happen and how can I solve this problem?
Thanks!
-
It turned out that it was caused by Google Page Speed. They told me that it was fine and nothing to worry about but I just disabled it due to server issues and I guess that is what made the code disappear...
-
Maybe Jill removed it yet at your suggestion
-
it looks like you figured out what that weird code was? I don't see it in the source code anymore.
-
you can fetch google in WMT and googlebot will recrawl
-
I'm sure that you checked yet:
-No important directory is blocked from robots.txt
-The robots.txt detected through Google Webmaster Tools match with the actual file robots.txt (i recently haved a trouble with that)
-New pages are well linked from home
-New pages are in sitemaps.xml with good priority and a dayly update
Share the content imediately with Google plus, it helps!
I cannot be sure, but maybe if Google was much time crawling your site without finding changes, decided to crawl it less frequently
Good Luck!
-
It is indexed but the problem is that most of the indexed pages are outdated and the new ones haven't been crawled.
I would LOVE to know whats up with all of that code. I have been trying to uncover that with no success.... I have no idea where it comes from but also no idea how to find out
-
It's indexed in Google.com
you should geotarget for www.google.co.il
what's up with all of this code that goes on forever in your source
/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ימי הולדת\" href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;small__psa_gt;יום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"בצק סוכר\" href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;בצק סוכר__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"הזמנות ליום הולדת\" href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;הזמנות ליום הולדת__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ברכות ליום הולדת\" href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;small__psa_gt;ברכות ליום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthday-cakes.html\"__psa_gt;__psa_lt;img alt=\"עוגות יום הולדת\" src=\"http://4-ps.googleusercontent.com/x/www.yetzira.com/yetzira.nicole.netdna-cdn.com/xbirthday,P20cake.jpg.pagespeed.ic._Ygk-OCr6B.jpg\" width=\"71\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;img alt=\"יום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/birthday.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;__psa_lt;img title=\"בצק סוכר\" alt=\"בצק סוכר\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/RFM.jpg\" width=\"39\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15858 alignright\" alt=\"הזמנות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/invites.jpg\" width=\"50\" height=\"56\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt; __psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15856 alignright\" alt=\"ברכות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/cards.jpg\" width=\"70\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;/tbody__psa_gt;\n__psa_lt;/table__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;__psa_lt;/h2__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;עיצוב הבית__psa_lt;/h2__psa_gt;\n__psa_lt;table border=\"0\" panel-id=\"panel-id.0\"__psa_gt;\n__psa_lt;tbody__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;small__psa_gt;עיצוב חדרי ילדים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/home.html\"__psa_gt;עיצוב הבית__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/learn-itzuv.html\"__psa_gt;לימודי עיצוב__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/ציורים.html\"__psa_gt;__psa_lt;small__psa_gt;ציורים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;img alt=\"עיצוב חדרי ילדים\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/child-room.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td__psa_gt;__psa -
My link profile contains natural links only. I have never asked for a link or even exchanged links with anyone.
About 4 years ago my site was hacked and the hackers linked to the content that they inserted in my forum. I have since erased the forum and disavowed the links even though over the years the spammy sites stopped linking to me anyway since their content was removed. This was a long time ago anyway so I don't think it is relevant.
I don't have that many links although the ones I have all linked to me because I have unique content.
My bounce rate has always been around 1%. My users seem to enjoy my content and spend time on my site. My rankings also went down very much since Google stopped crawling. I can't work out why.
-
I have a lot of 404 errors which appear in Google Webmaster Tools but don't appear on my site anymore.
About a month ago I had a problem with Wordpress permalinks and for about 10 hours my posts were crawled under a slightly different URL. During that time many posts were crawled and therefore existed under 2 different URLs. I have since fixed the problem but since Google hasn't really come back to crawl so the errors still appear.
-
Streamline Metrics is correct. Add it to webmaster tools and see what they say. Also, how is your link profile? Any spammy links?
-
Have you claimed the site in Google Webmaster Tools? If not, I suggest doing so at http://www.google.com/webmasters and then you will be able to see if Google has encountered any errors lately and/or you can change the crawl rate if necessary.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can adding thousands of new indexable URLs to my site at once be a problem?
Hi everyone, I am currently working on a project that will quickly add thousands of new indexable URLs to my site. For context, the site currently has over a million indexable pages. Is there any danger of adding a few thousand URLs at once to the site? Could it potentially affect crawlability/SEO/other pages? Thank you!
Technical SEO | | StevenLevine0 -
Google Search Console Site Map Anomalies (HTTP vs HTTPS)
Hi I've just done my usual Monday morning review of clients Google Search Console (previously Webmaster Tools) dashboard and disturbed to see that for 1 client the Site Map section is reporting 95 pages submitted yet only 2 indexed (last time i looked last week it was reporting an expected level of indexed pages) here. It says the sitemap was submitted on the 10th March and processed yesterday. However in the 'Index Status' its showing a graph of growing indexed pages up to & including yesterday where they numbered 112 (so looks like all pages are indexed after all). Also the 'Crawl Stats' section is showing 186 pages crawled on the 26th. Then its listing sub site-maps all of which are non HTTPS (http) which seems very strange since the site is HTTPS and has been for a few months now and the main sitemap index url is an HTTPS: https://www.domain.com/sitemap_index.xml The sub sitemaps are:http://www.domain.com/marketing-sitemap.xmlhttp://www.domain.com/page-sitemap.xmlhttp://www.domain.com/post-sitemap.xmlThere are no 'Sitemap Errors' reported but there are 'Index Error' warnings for the above post-sitemap, copied below:_"When we tested a sample of the URLs from your Sitemap, we found that some of the URLs were unreachable. Please check your webserver for possible misconfiguration, as these errors may be caused by a server error (such as a 5xx error) or a network error between Googlebot and your server. All reachable URLs will still be submitted." _
Technical SEO | | Dan-Lawrence
Also for the below site map URL's: "Some URLs listed in this Sitemap have a high response time. This may indicate a problem with your server or with the content of the page" for:http://domain.com/en/post-sitemap.xmlANDhttps://www.domain.com/page-sitemap.xmlAND https://www.domain.com/post-sitemap.xmlI take it from all the above that the HTTPS sitemap is mainly fine and despite the reported 0 pages indexed in GSC sitemap section that they are in fact indexed as per the main 'Index Status' graph and that somehow some HTTP sitemap elements have been accidentally attached to the main HTTPS sitemap and the are causing these problems.What's best way forward to clean up this mess ? Resubmitting the HTTPS site map sounds like right option but seeing as the master url indexed is an https url cant see it making any difference until the http aspects are deleted/removed but how do you do that or even check that's what's needed ? Or should Google just sort this out eventually ? I see the graph in 'Crawl > Sitemaps > WebPages' is showing a consistent blue line of submitted pages but the red line of indexed pages drops to 0 for 3 - 5 days every 5 days or so. So fully indexed pages being reported for 5 day stretches then zero for a few days then indexed for another 5 days and so on ! ? Many ThanksDan0 -
Google is not indexing my new URL structure. Why not?
Hi all, We launched a new website for a customer on April 29th. That same day we resubmitted the new sitemap & asked Google to fetch the new website. Screenshot is attached of this (GWT Indexed). However, when I look at Google Index (see attachment - Google Index), Automated Production's old website URL's still appear. It's been two weeks. Is it normal for Google's index to take this long to update? Thanks for your help. Cole VoLPjhy vfxVUsO
Technical SEO | | ColeLusby0 -
Meta keywords shown in Google SERPS as site description
I'm seeing Google display meta-keywords in the SERP description for some sites (at least a half dozen that I've checked). I BELIEVE IT IS AN AJAX ISSUE BECAUSE: The sites all use AJAX to display content. So the meta-keywords are in the header, and the javascript that displays the content. Non-AJAX parts of the site display properly in Google SERPS The meta-keywords don't visibly appear anywhere on the page. When I turn off images and Javascript in Chrome I don't see any hidden keyword text. I BELIEVE IT IS A GOOGLE-SPECIFIC ISSUE BECAUSE: Each site displays properly in Bing and Yahoo SERPS - the meta-description is the description. However, (as expected) I see the same strange meta-keyword activity in Aol search In Screaming Frog's SERP preview I see the meta-description as the description. Google has been ignoring met-keywords for years. Any idea why it's appearing in the SERPS for these AJAX powered sites? I found one other person who saw that Google may be reading and displaying their content in AJAX even though that content is meant to appear on a different "page". No one on that Google Forum seemed to understand the person's problem. The only reason I get it is because now I'm seeing it with my own eyes. I know the Moz community can do better, so i'm posting about it here.
Technical SEO | | AlexCobb0 -
My site was Not removed from google, but my most visited page was. what does that mean?
Help. My most important page http://hoodamath.com/games/ has disappeared from google, why the rest of my site still remains. i can't find anything about this type of ban. any help would be appreciated ( i would like to sleep tonight)
Technical SEO | | hoodamath0 -
Can anyone help me understand why google is "Not Selecting" a large number of my webpages to include when crawling my site.
When looking through my google webmaster tools, I clicked into the advanced settings under index status and was surprised to see that google has marked around 90% of my pages on my site as "Not Selected" when crawling. Please take a look and offer any suggestions. www.luxuryhomehunt.com
Technical SEO | | Jdubin0 -
My site cannot be found by google at all
I don't know why but our company site can not be found by google at all. I have submitted to google webmaster, have social media point to, etc, Is there any reason for this? url for our website is www.bistosamerica.com Thank you
Technical SEO | | BistosAmerica0 -
Dynamically-generated .PDF files, instead of normal pages, indexed by and ranking in Google
Hi, I come across a tough problem. I am working on an online-store website which contains the functionlaity of viewing products details in .PDF format (by the way, the website is built on Joomla CMS), now when I search my site's name in Google, the SERP simply displays my .PDF files in the first couple positions (shown in normal .PDF files format: [PDF]...)and I cannot find the normal pages there on SERP #1 unless I search the full site domain in Google. I really don't want this! Would you please tell me how to figure the problem out and solve it. I can actually remove the corresponding component (Virtuemart) that are in charge of generating the .PDF files. Now I am trying to redirect all the .PDF pages ranking in Google to a 404 page and remove the functionality, I plan to regenerate a sitemap of my site and submit it to Google, will it be working for me? I really appreciate that if you could help solve this problem. Thanks very much. Sincerely SEOmoz Pro Member
Technical SEO | | fugu0