Why did Google stop indexing my site?
-
Google used to crawl my site every few minutes.
Suddenly it stopped and the last week it indexed 3 pages out of thousands.
What could cause this to happen and how can I solve this problem?
Thanks!
-
It turned out that it was caused by Google Page Speed. They told me that it was fine and nothing to worry about but I just disabled it due to server issues and I guess that is what made the code disappear...
-
Maybe Jill removed it yet at your suggestion
-
it looks like you figured out what that weird code was? I don't see it in the source code anymore.
-
you can fetch google in WMT and googlebot will recrawl
-
I'm sure that you checked yet:
-No important directory is blocked from robots.txt
-The robots.txt detected through Google Webmaster Tools match with the actual file robots.txt (i recently haved a trouble with that)
-New pages are well linked from home
-New pages are in sitemaps.xml with good priority and a dayly update
Share the content imediately with Google plus, it helps!
I cannot be sure, but maybe if Google was much time crawling your site without finding changes, decided to crawl it less frequently
Good Luck!
-
It is indexed but the problem is that most of the indexed pages are outdated and the new ones haven't been crawled.
I would LOVE to know whats up with all of that code. I have been trying to uncover that with no success.... I have no idea where it comes from but also no idea how to find out
-
It's indexed in Google.com
you should geotarget for www.google.co.il
what's up with all of this code that goes on forever in your source
/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ימי הולדת\" href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;small__psa_gt;יום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"בצק סוכר\" href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;בצק סוכר__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"הזמנות ליום הולדת\" href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;הזמנות ליום הולדת__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ברכות ליום הולדת\" href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;small__psa_gt;ברכות ליום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthday-cakes.html\"__psa_gt;__psa_lt;img alt=\"עוגות יום הולדת\" src=\"http://4-ps.googleusercontent.com/x/www.yetzira.com/yetzira.nicole.netdna-cdn.com/xbirthday,P20cake.jpg.pagespeed.ic._Ygk-OCr6B.jpg\" width=\"71\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;img alt=\"יום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/birthday.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;__psa_lt;img title=\"בצק סוכר\" alt=\"בצק סוכר\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/RFM.jpg\" width=\"39\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15858 alignright\" alt=\"הזמנות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/invites.jpg\" width=\"50\" height=\"56\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt; __psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15856 alignright\" alt=\"ברכות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/cards.jpg\" width=\"70\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;/tbody__psa_gt;\n__psa_lt;/table__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;__psa_lt;/h2__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;עיצוב הבית__psa_lt;/h2__psa_gt;\n__psa_lt;table border=\"0\" panel-id=\"panel-id.0\"__psa_gt;\n__psa_lt;tbody__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;small__psa_gt;עיצוב חדרי ילדים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/home.html\"__psa_gt;עיצוב הבית__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/learn-itzuv.html\"__psa_gt;לימודי עיצוב__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/ציורים.html\"__psa_gt;__psa_lt;small__psa_gt;ציורים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;img alt=\"עיצוב חדרי ילדים\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/child-room.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td__psa_gt;__psa -
My link profile contains natural links only. I have never asked for a link or even exchanged links with anyone.
About 4 years ago my site was hacked and the hackers linked to the content that they inserted in my forum. I have since erased the forum and disavowed the links even though over the years the spammy sites stopped linking to me anyway since their content was removed. This was a long time ago anyway so I don't think it is relevant.
I don't have that many links although the ones I have all linked to me because I have unique content.
My bounce rate has always been around 1%. My users seem to enjoy my content and spend time on my site. My rankings also went down very much since Google stopped crawling. I can't work out why.
-
I have a lot of 404 errors which appear in Google Webmaster Tools but don't appear on my site anymore.
About a month ago I had a problem with Wordpress permalinks and for about 10 hours my posts were crawled under a slightly different URL. During that time many posts were crawled and therefore existed under 2 different URLs. I have since fixed the problem but since Google hasn't really come back to crawl so the errors still appear.
-
Streamline Metrics is correct. Add it to webmaster tools and see what they say. Also, how is your link profile? Any spammy links?
-
Have you claimed the site in Google Webmaster Tools? If not, I suggest doing so at http://www.google.com/webmasters and then you will be able to see if Google has encountered any errors lately and/or you can change the crawl rate if necessary.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Recover google INdexing issue after fixing malware attack.
Dear My Niche site attacked by malware on 1 st march 2018. Hacker inject a php file on my blogpage. Injected link like: mydomain.com/blog/dmy4xa.php? Then I scan My site by wordfence. Identifying all malware code.Then manually clean whole site with database. My site is completely free from malware. and remove all malware link from webmaster tools. Even Block my blog page by robots.txt . But new malware link index every week. So i need to remove those link every week. So this issue I decided to rebuild my site. Finally I rebuild my site another server. Then I flash my current server and migrate my site from those server on 10th january 2019 . I wait 1 month to deindex malware link. But new link are indexing every week. I discourage site for over 1 week and even delete site from google webmaster tools with all properties as well as verification file from server. Over 1 week , Link are showing. I feel boar to delete malware link every week. I need permanent solution. Please give me a perfect solution for this malware link index. Google index about 100 url .After that I clean my site with some tools. My site was free from malware. But Ne
Technical SEO | | Gfound1230 -
No Longer Indexed in Google (Says Redirected)
Just recently my page, http:/www./waikoloavacationrentals.com/mauna-lani-terrace, was no longer indexed by google. The sub pages from it still are. I have not done anything sketchy with the page. When I went into the google fetch it says that it is redirected. Any ideas what is this all about? Here is what it says for the fetch: Http/1.1 301 moved permanently
Technical SEO | | RobDalton
Server: nginx
Date: Tue, 07 Mar 2017 00:43:26GMT
Content-Type: text/html
Content-Length: 178
Connection: keep-alive
Keep-Alive: timeout=20
Location: http://waikoloavacationrentals.com/mauna-lani-terrace <title>301 moved permanently</title> <center> 301 moved permanently </center> <center>nginx</center>0 -
Google Search Console Site Map Anomalies (HTTP vs HTTPS)
Hi I've just done my usual Monday morning review of clients Google Search Console (previously Webmaster Tools) dashboard and disturbed to see that for 1 client the Site Map section is reporting 95 pages submitted yet only 2 indexed (last time i looked last week it was reporting an expected level of indexed pages) here. It says the sitemap was submitted on the 10th March and processed yesterday. However in the 'Index Status' its showing a graph of growing indexed pages up to & including yesterday where they numbered 112 (so looks like all pages are indexed after all). Also the 'Crawl Stats' section is showing 186 pages crawled on the 26th. Then its listing sub site-maps all of which are non HTTPS (http) which seems very strange since the site is HTTPS and has been for a few months now and the main sitemap index url is an HTTPS: https://www.domain.com/sitemap_index.xml The sub sitemaps are:http://www.domain.com/marketing-sitemap.xmlhttp://www.domain.com/page-sitemap.xmlhttp://www.domain.com/post-sitemap.xmlThere are no 'Sitemap Errors' reported but there are 'Index Error' warnings for the above post-sitemap, copied below:_"When we tested a sample of the URLs from your Sitemap, we found that some of the URLs were unreachable. Please check your webserver for possible misconfiguration, as these errors may be caused by a server error (such as a 5xx error) or a network error between Googlebot and your server. All reachable URLs will still be submitted." _
Technical SEO | | Dan-Lawrence
Also for the below site map URL's: "Some URLs listed in this Sitemap have a high response time. This may indicate a problem with your server or with the content of the page" for:http://domain.com/en/post-sitemap.xmlANDhttps://www.domain.com/page-sitemap.xmlAND https://www.domain.com/post-sitemap.xmlI take it from all the above that the HTTPS sitemap is mainly fine and despite the reported 0 pages indexed in GSC sitemap section that they are in fact indexed as per the main 'Index Status' graph and that somehow some HTTP sitemap elements have been accidentally attached to the main HTTPS sitemap and the are causing these problems.What's best way forward to clean up this mess ? Resubmitting the HTTPS site map sounds like right option but seeing as the master url indexed is an https url cant see it making any difference until the http aspects are deleted/removed but how do you do that or even check that's what's needed ? Or should Google just sort this out eventually ? I see the graph in 'Crawl > Sitemaps > WebPages' is showing a consistent blue line of submitted pages but the red line of indexed pages drops to 0 for 3 - 5 days every 5 days or so. So fully indexed pages being reported for 5 day stretches then zero for a few days then indexed for another 5 days and so on ! ? Many ThanksDan0 -
Pages to be indexed in Google
Hi, We have 70K posts in our site but Google has scanned 500K pages and these extra pages are category pages or User profile pages. Each category has a page and each user has a page. When we have 90K users so Google has indexed 90K pages of users alone. My question is. Should we leave it as they are or should we block them from being indexed? As we get unwanted landings to the pages and huge bounce rate. If we need to remove what needs to be done? Robots block or Noindex/Nofollow Regards
Technical SEO | | mtthompsons0 -
Do Com Junct links affect your site with Google and Penguin
We received the dreaded letter from google in reference to "unnatural or artificial links" Our site has affiliate programs through Commission Junction and Link Share and between the two programs we have over 8000 affiliates or advertisers. Our site has been very successful, but our organic search traffic is down as our rankings in the search engines have dropped. My question is do the affiliate links have an effect on our site with Panda or Penguin?
Technical SEO | | Statrak0 -
Google Duplicate Content Penalty On My Own Site?
I am certain that I have hit a google penalty filter for my site http://www.playpokeronline.ca for my main keywords "play poker online" in google.ca I rank 670th and used to be on the first page between 1 and 10 in June. On Bing I am like 9th On my site I found the entire site duplicated as follows Original: www.playpokeronline.ca Duplicate www.playpokeronline.ca/playpokeronline/ this duplicate was not intentional and seems to be a result of my hosting at godaddy. for every page on my site and it shows up in webmaster tools I blocked the duplicate with robots.txt and a few days ago dropped it and wrote a rel=connonical tag in the top of each page visitors dropped from 100 per day in august to 12-20 in the last month. Google says that if duplicate content is made to try to game serps they may filter or penalize my site. Have I triggered this penalty or a different sort of over optimization penalty? Will the rel= canonical tags fix this or should i do something else? This Penalty Business is Not my Idea of a good time Thank You Jeb
Technical SEO | | PokerCanada0 -
301 an old site to a newer site...
Hi First, to be upfront - these are not my websites, I'm asking because they are trying to compete in my niche. Here's the details, then the questions... There is a website that is a few months old with about 200 indexed pages and about 20 links, call this newsite.com There is a website that is a few years old with over 10,000 indexed pages and over 20,000 links, call this oldsite.com newsite.com acquired oldsite.com and set a 301 redirect so every page of oldsite.com is re-directed to the front page of newsite.com newsite.com & oldsite.com are on the same topic, the 301 occurred in the past week. Now, oldsite.com is out of the SERPs and newsite.com is pretty much ranking in the same spot (top 10) for the main term. Here are my questions; 1. The 10,000 pages on oldsite.com had plenty of internal links - they no longer exists, so I imagine when the dust settles - it will be like oldsite.com is a one page site that re-diretcts to newsite.com ... How long will a ranking boost last for? 2. With the re-direct setup to completely forget about the structure and content of oldsite.com, it's clear to me that it was setup to pass the 'Link Juice' from oldsite.com to newsite.com ... Do the major SE's see this as a form of SPAM (manipulating the rankings), or do they see it as a good way to combine two or more websites? 3. Does this work? Is everybody doing it? Should I be doing it? ... or are there better ways for me to combat this type of competition (eg we could make a lot of great content for the money spent buying oldsite.com - but we certainly wouldn't get such an immediate increase to traffic)?
Technical SEO | | RR5000 -
Some site pages are removed from Google Index
Hello, Some pages of my clients website are removed from Google Index. We were in top 10 position for some keywords but now I cannot find those pages neither in top 1000. Any idea what to do in order to get these pages back? thank you
Technical SEO | | besartbajrami0