Google cant read my robots.txt from past 10 days
-
http://awesomescreenshot.com/08d1s6aybc
hi, my robots.txt is
http://wallpaperzoo.com/robots.txt
google says it cant read and has postponed the crawl.. its been 10 days and no crawl.. please help me in solving this issue.. this is save with
-
Hi sir Google started fetching again
thank you for your help -
What you can do is from within Google Webmaster Tools is to ask Google to fetch the URL of the sitemap and then 'submit it to the index'. That's one technique I've seen working before.
Google Webmaster Tools or Googlebot doesn't seem to crawl robots.txt files very often. Have seen it a couple of times where it could take days for them to crawl the file again after I've changed something.
-
hi sir, there was a problem on 23rd september in robots.txt which i fixed on 25th after then google bot dint come.. how much time it will take to come back again?
-
There's nothing wrong with your robots.txt file as far as I can see. It is likely that Google tried accessing the robots.txt file when your server was slow/down for a split second and that's why you are seeing the error. Are you sure that the site hasn't been crawled in 10 days? Have you checked your server log files to verify that? Regardless, once Googlebot does eventually come back, it should read the robots.txt file correctly and then you should be good to go.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Hit by an unnamed Google update on November 30th - Still suffering
Hi, Moz Community. Just decided to sign up for a free trial because I'm absolutely at my wits end here. Here's my site: cheapgamesguru.com I run a small PC gaming blog monetized by affiliate marketing. I do all the writing, SEO, etc. myself. The content I write is, from what I can tell, fully complying with Google's guidelines, and in and of itself is pretty informative and high-quality. My site was started in December of 2015, and it was doing very well for a good 10 or 11 months - until late November of 2016. Then something happened. My traffic started plummeting - I went from getting nearly 300 organic users a day (Not sessions - actual unique users) to 80, then 40, and now I'm lucky to get over 15 a day. I do not do ANY black hat SEO whatsoever. I have not taken part in any shady link building schemes, nor do I try to trick Google in any way. I just write good content, do good keyword research (Targeting only low-hanging fruit and low-difficulty keywords using KWFinder), and do my best to provide a good user experience. I run no ads on my site. Glenn Gabe wrote about a potential Google update on November 29th, but the stuff he said in his article doesn't seem to affect me - my mobile site is perfectly fine, according to Google's own metrics and testing tools. Here's the article in question: http://www.gsqi.com/marketing-blog/november-30-2016-google-algorithm-update/ At first, I thought it was possible that this was a result of my competitors simply doing far better than me - but that doesn't seem to be the case, as their rankings did not actually move - mine simply pummeted. And many of their sites are far worse than mine in terms of grammar, spelling, and site speed. I understand backlinks are important, by the way, but I really don't think that's why my site was hit. Many competitors of mine have little to no backlinks and are doing great, and it would also not make much sense for Google to hit an otherwise great site just because they have few backlinks. A friend of mine has reached out to Glenn Gabe himself to see if he can get his input on my site, but he's had a busy schedule and hasn't gotten a chance to take a look yet. I recently obtained a backlink from a highly relevant DA 65 site (About a month ago, same niche as my site), and it now shows up in Search Console and Ahrefs - but it hasn't affected rankings whatsoever. Important Note: I'm not only just ranking poorly for stuff, I'm ranking in position 100-150+ for many low-competition keywords. I have no idea why that is happening - is my site THAT bad, that my content deserves to be ranking on page 15 or lower? Sorry for the long question. I'm struggling here, and just wanted to give as much information as possible. I would really appreciate any input you guys can give me - if any SEO experts want to turn my site into a case study and work with me to improve things, I'd also be open to that 😉 I kid, of course - I know you guys are all busy. Thanks! P.S. I've attached a picture of my SEMRush graph, for reference, as well. mhgSw
Algorithm Updates | | polycountz0 -
Have there been any google algorithm updates in the past 2 weeks?
Hi guys - we have noticed a site we work one has taken a hit on its rankings over the past week. We have been through all the usual reason - hacking, duplicate content, back links, other sites copying text etc - but can not find any reason why its rankings have been affected. Has any one else noticed unexplained changes in rankings with sites about a week ago? Thanks in advance! Phil
Algorithm Updates | | Globalgraphics1 -
Best and easiest Google Depersonalization method
Hello, Moz hasn't written anything about depersonalization for years. This article has methods, but I don't know if they are valid anymore. What's an easy, effective way to depersonalize Google search these days? I would just log out of Google, but that shows different ranking results than Moz's rank tracker for one of our main keywords, so I don't know if that method is correct. Thanks
Algorithm Updates | | BobGW0 -
Anyone experience google penalties for full-screen pop-ups?
Although we always recommend against onload pop-ups for clients, (we feel the effect the user experience) we do have a few clients that insist on them. I was reading this article the other day https://searchenginewatch.com/2016/05/17/how-do-i-make-sure-my-site-is-mobile-friendly/ which lead me to https://support.google.com/webmasters/answer/6101188 and I'm happy to see that Google is going to consider these types of content a downgrade when it comes to rank. My question is 2 fold: Has anyone experienced a drop in organic traffic on mobile due to this update? and do you think this will include user triggered content like photo galleries, bookings, email sign ups? We haven't noticed any drops yet but it is something we will be keeping a close eye on in the next little while. Let's hear what the community has to say 🙂
Algorithm Updates | | VERBInteractive1 -
What are tips for ranking on Google Maps?
I have another thread going where everyone is saying to keep both the Places profile as well as the Google Plus Local profile I have for my company. I have another person telling me that it has a negative effect to have both accounts at the same time so I'm assuming thats why the listing never comes up on places unless you zoom all the way into the map to the address of the storefront. With that being said, can anyone provide some good tips for ranking first page on google maps? Goole Plus Local - https://plus.google.com/114370561649922317296/about?gl=us&hl=en Google Places - https://plus.google.com/103220086647895058915/about?gl=us&hl=en
Algorithm Updates | | jonnyholt1 -
Has anyone experienced a dramatic decrease in Google rankings followed by a dramatic increase in the past few days?
I don't want to be one of those whiny people always asking about rankings, but for the first time in a while, I've seen some crazy fluctuations in Google rankings. I was wondering if anyone had any similar experiences lately.
Algorithm Updates | | innovationsimple0 -
Profile Picture Display Next to Map on Google Search
On a recent Google search, I noticed that the top result also displayed the Google map of the location next to it but aside from that, it also displayed that business' Google+ Profile picture. I'm wondering how that is done. We have a Google+ account as well with an image associated with our business. At this point, the map doesn't even display for our business, but how does one get the map and the profile picture to appear on search results? Here's a link to the search result in question:
Algorithm Updates | | atuomala
http://www.google.com/search?q=tech+squad&rlz=1C1CHFX_enUS511US511&aq=f&oq=tech+squad&sourceid=chrome&ie=UTF-8#hl=en&rlz=1C1CHFX_enUS511US511&sclient=psy-ab&q=tech+squad+wi&oq=tech+squad+wi&gs_l=serp.3..0l2j0i30l2.6041.6590.0.6592.3.3.0.0.0.0.79.158.2.2.0.les%3B..0.0...1c.1.4.psy-ab.DoA-PSlyt-A&pbx=1&bav=on.2,or.r_gc.r_pw.r_qf.&bvm=bv.42768644,d.cGE&fp=b5d841bb1ab219dc&biw=1440&bih=785 tech_squad_serp.jpg0 -
Google local page
I was in google places and then set up a goole local account 9 months ago but it is not showing as listed. What am I doing wrong or what can I do about it?? https://plus.google.com/u/0/106415232585067786390/about thanks Jo Ann
Algorithm Updates | | jojojo0