Why did Google stop indexing my site?
-
Google used to crawl my site every few minutes.
Suddenly it stopped and the last week it indexed 3 pages out of thousands.
What could cause this to happen and how can I solve this problem?
Thanks!
-
It turned out that it was caused by Google Page Speed. They told me that it was fine and nothing to worry about but I just disabled it due to server issues and I guess that is what made the code disappear...
-
Maybe Jill removed it yet at your suggestion
-
it looks like you figured out what that weird code was? I don't see it in the source code anymore.
-
you can fetch google in WMT and googlebot will recrawl
-
I'm sure that you checked yet:
-No important directory is blocked from robots.txt
-The robots.txt detected through Google Webmaster Tools match with the actual file robots.txt (i recently haved a trouble with that)
-New pages are well linked from home
-New pages are in sitemaps.xml with good priority and a dayly update
Share the content imediately with Google plus, it helps!
I cannot be sure, but maybe if Google was much time crawling your site without finding changes, decided to crawl it less frequently
Good Luck!
-
It is indexed but the problem is that most of the indexed pages are outdated and the new ones haven't been crawled.
I would LOVE to know whats up with all of that code. I have been trying to uncover that with no success.... I have no idea where it comes from but also no idea how to find out
-
It's indexed in Google.com
you should geotarget for www.google.co.il
what's up with all of this code that goes on forever in your source
/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ימי הולדת\" href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;small__psa_gt;יום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"בצק סוכר\" href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;בצק סוכר__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"הזמנות ליום הולדת\" href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;הזמנות ליום הולדת__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a title=\"ברכות ליום הולדת\" href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;small__psa_gt;ברכות ליום הולדת__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthday-cakes.html\"__psa_gt;__psa_lt;img alt=\"עוגות יום הולדת\" src=\"http://4-ps.googleusercontent.com/x/www.yetzira.com/yetzira.nicole.netdna-cdn.com/xbirthday,P20cake.jpg.pagespeed.ic._Ygk-OCr6B.jpg\" width=\"71\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/birthdays.html\"__psa_gt;__psa_lt;img alt=\"יום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/birthday.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a6%d7%a7-%d7%a1%d7%95%d7%9b%d7%a8.html\"__psa_gt;__psa_lt;img title=\"בצק סוכר\" alt=\"בצק סוכר\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/RFM.jpg\" width=\"39\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/%d7%94%d7%96%d7%9e%d7%a0%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15858 alignright\" alt=\"הזמנות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/invites.jpg\" width=\"50\" height=\"56\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt; __psa_lt;a href=\"http://www.yetzira.com/%d7%91%d7%a8%d7%9b%d7%95%d7%aa-%d7%9c%d7%99%d7%95%d7%9d-%d7%94%d7%95%d7%9c%d7%93%d7%aa.html\"__psa_gt;__psa_lt;img class=\"size-full wp-image-15856 alignright\" alt=\"ברכות ליום הולדת\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/cards.jpg\" width=\"70\" height=\"50\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;/tbody__psa_gt;\n__psa_lt;/table__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;__psa_lt;/h2__psa_gt;\n__psa_lt;h2 panel-id=\"panel-id.0\"__psa_gt;עיצוב הבית__psa_lt;/h2__psa_gt;\n__psa_lt;table border=\"0\" panel-id=\"panel-id.0\"__psa_gt;\n__psa_lt;tbody__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;small__psa_gt;עיצוב חדרי ילדים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/home.html\"__psa_gt;עיצוב הבית__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;small__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/learn-itzuv.html\"__psa_gt;לימודי עיצוב__psa_lt;/a__psa_gt;__psa_lt;/small__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;td style=\"width: 110px;\"__psa_gt;\n__psa_lt;h3__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/ציורים.html\"__psa_gt;__psa_lt;small__psa_gt;ציורים__psa_lt;/small__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/h3__psa_gt;\n__psa_lt;/td__psa_gt;\n__psa_lt;/tr__psa_gt;\n__psa_lt;tr__psa_gt;\n__psa_lt;td__psa_gt;__psa_lt;a href=\"http://www.yetzira.com/designkidsroom.html\"__psa_gt;__psa_lt;img alt=\"עיצוב חדרי ילדים\" src=\"http://www.yetzira.com/wp-content/uploads/2009/08/child-room.jpg\"/__psa_gt;__psa_lt;/a__psa_gt;__psa_lt;/td__psa_gt;\n__psa_lt;td__psa_gt;__psa -
My link profile contains natural links only. I have never asked for a link or even exchanged links with anyone.
About 4 years ago my site was hacked and the hackers linked to the content that they inserted in my forum. I have since erased the forum and disavowed the links even though over the years the spammy sites stopped linking to me anyway since their content was removed. This was a long time ago anyway so I don't think it is relevant.
I don't have that many links although the ones I have all linked to me because I have unique content.
My bounce rate has always been around 1%. My users seem to enjoy my content and spend time on my site. My rankings also went down very much since Google stopped crawling. I can't work out why.
-
I have a lot of 404 errors which appear in Google Webmaster Tools but don't appear on my site anymore.
About a month ago I had a problem with Wordpress permalinks and for about 10 hours my posts were crawled under a slightly different URL. During that time many posts were crawled and therefore existed under 2 different URLs. I have since fixed the problem but since Google hasn't really come back to crawl so the errors still appear.
-
Streamline Metrics is correct. Add it to webmaster tools and see what they say. Also, how is your link profile? Any spammy links?
-
Have you claimed the site in Google Webmaster Tools? If not, I suggest doing so at http://www.google.com/webmasters and then you will be able to see if Google has encountered any errors lately and/or you can change the crawl rate if necessary.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should I "no-index" two exact pages on Google results?
Hello everyone, I recently started a new wordpress website and created a static homepage. I noticed that on Google search results, there are two different URLs landing on same content page. I've attached an image to explain what I saw. Should I "no-index" the page url? Google url.JPG In this picture, the first result is the homepage and I try to rank for that page. The last result is landing on same content with different URL. So, should I no-index last result as shown in image?
Technical SEO | | amanda59640 -
Google Indexed a version of my site w/ MX record subdomain
We're doing a site audit and found "internal" links to a page in search console that appear to be from a subdomain of our site based on our MX record. We use Google Mail internally. The links ultimately redirect to our correct preferred subdomain "www", but I am concerned as to why this is happening and if it can have any negative SEO implications. Example of one of the links: Links aspmx3.googlemail.com.sullivansolarpower.com/about/solar-power-blog/daniel-sullivan/renewable-energy-and-electric-cars-are-not-political-footballs I did a site operator search, site:aspmx3.googlemail.com.sullivansolarpower.com on google and it returns several results.
Technical SEO | | SS.Digital0 -
Fake Links indexing in google
Hello everyone, I have an interesting situation occurring here, and hoping maybe someone here has seen something of this nature or be able to offer some sort of advice. So, we recently installed a wordpress to a subdomain for our business and have been blogging through it. We added the google webmaster tools meta tag and I've noticed an increase in 404 links. I brought this up to or server admin, and he verified that there were a lot of ip's pinging our server looking for these links that don't exist. We've combed through our server files and nothing seems to be compromised. Today, we noticed that when you do site:ourdomain.com into google the subdomain with wordpress shows hundreds of these fake links, that when you visit them, return a 404 page. Just curious if anyone has seen anything like this, what it may be, how we can stop it, could it negatively impact us in anyway? Should we even worry about it? Here's the link to the google results. https://www.google.com/search?q=site%3Amshowells.com&oq=site%3A&aqs=chrome.0.69i59j69i57j69i58.1905j0j1&sourceid=chrome&es_sm=91&ie=UTF-8 (odd links show up on pages 2-3+)
Technical SEO | | mshowells0 -
Does Site Structure Affect Google
Hi - I'm pretty new at this. We’re running an e-commerce affiliate site at http://www.mydomain.com. So we don’t take payments but customer gets passed through to third party sites when they select to buy a product. We have a blog at http://www.mydomain.com/news. I think Google is treating these 2 sites as as separate sites for PR. For this reason we're thinking about moving this to http://news.mydomain.com. Anyone have any experience in this?
Technical SEO | | richardjoseph0 -
How to get Google to index another page
Hi, I will try to make my question clear, although it is a bit complex. For my site the most important keyword is "Insurance" or at least the danish variation of this. My problem is that Google are'nt indexing my frontpage on this, but are indexing a subpage - www.mydomain.dk/insurance instead of www.mydomain.dk. My link bulding will be to subpages and to my main domain, but i wont be able to get that many links to www.mydomain.dk/insurance. So im interested in making my frontpage the page that is my main page for the keyword insurance, but without just blowing the traffic im getting from the subpage at the moment. Is there any solutions to do this? Thanks in advance.
Technical SEO | | Petersen110 -
Changed cms - google indexes old and new pages
Hello again, after posting below problem I have received this answer and changed sitemap name Still I receive many duplicate titles and metas as google still compares old urls to new ones and sees duplicate title and description.... we have redirectged all pages properly we have change sitemap name and new sitemap is listed in webmastertools - old sitemap includes ONLY new sitemap files.... When you deleted the old sitemap and created a new one, did you use the same sitemap xml filename? They will still try to crawl old URLs that were in your previous sitemap (even if they aren't listed in the new one) until they receive a 404 response from the original sitemap. If anone can give me an idea why after 3 month google still lists the old urls I'd be more than happy thanks a lot Hello, We have changed cms for our multiple language website and redirected all odl URl's properly to new cms which is working just fine.
Technical SEO | | Tit
Right after the first crawl almost 4 weeks ago we saw in google webmaster tool and SEO MOZ that google indexes for almost every singlepage the old URL as well and the new one and sends us for this duplicate metatags.
We deleted the old sitemap and uploaded the new and thought that google then will not index the old URL's anymore. But we still see a huge amount of duplicate metatags. Does anyone know what else we can do, so google doe snot index the old url's anymore but only the new ones? Thanks so much Michelle0 -
I am trying to block robots from indexing parts of my site..
I have a few websites that I mocked up for clients to check out my work and get a feel for the style I produce but I don't want them indexed as they have lore ipsum place holder text and not really optimized... I am in the process of optimizing them but for the time being I would like to block them. Most of my warnings and errors on my seomoz dashboard are from these sites and I was going to upload the folioing to the robot.txt file but I want to make sure this is correct: User-agent: * Disallow: /salondemo/ Disallow: /salondemo3/ Disallow: /cafedemo/ Disallow: /portfolio1/ Disallow: /portfolio2/ Disallow: /portfolio3/ Disallow: /salondemo2/ is this all i need to do? Thanks Donny
Technical SEO | | Smurkcreative0 -
Google News not indexing .index.html pages
Hi all, we've been asked by a blog to help them better indexing and ranking on Google News (with the site being already included in Google News with poor results) The blog had a chronicle URL duplication problem with each post existing with 3 different URLs: #1) www.domain.com/post.html (currently in noindex for editorial choices as showing all the comments) #2) www.domain.com/post/index.html (currently indexed showing only top comments) #3) www.domain.com/post/ (very same as #2) We've chosen URL #2 (/index.html) as canonical URL, and included a rel=canonical tag on URL #3 (/) linking to URL #2.
Technical SEO | | H-FARM
Also we've submitted yesterday a Google News sitemap including consistently the list of URLs #2 from the last 48h . The sitemap has been properly "digested" by Google and shows that all URLs have been sent and indexed. However if we use the site:domain.com command on Google News we see something completely different: Google News has indexed actually only some news and more specifically only the URLs #3 type (ending with the trailing slash instead of /index.html). Why ? What's wrong ? a) Does Google News bot have problems indexing URLs ending with .index.html ? While figuring out what's wrong we've found out that http://news.google.it/news/search?aq=f&pz=1&cf=all&ned=us&hl=en&q=inurl%3Aindex.html gives no results...it seems that Google News index overall does not include any URLs ending with /index.html b) Does Google News bot recognise rel=canonical tag ? c) Is it just a matter of time and then Google News will pick up the right URLs (/index.html) and/or shall we communicate Google News team any changes ? d) Any suggestions ? OR Shall we do the other way around. meaning make URL #3 the canonical one ? While Google News is showing these problems, Google Web search has actually well received the changes, so we don't know what to do. Thanks for your help, Matteo0