How to recover after blocking all the search engine spiders?
-
I have the following problem - one of my clients (a Danish home improvement company) decided to block all the international traffic (leaving only Scandiavian one), because they were getting a lot of spammers using their mail form to send e-mails.
As you can guess this lead to blocking Google also since the servers of Google Denmark are located in the US. This lead to drop in their rankings. So my question is - What Shall I do now - wait or contact Google?
Any help will be appreciated, because to be honest I had never see such thing in action until now
Best Regards
-
I really apprciate your help Thanks for the fast reply. I really hope this is the last time they try such techniques, because it is kind of frustrating
-
One of our clients did this once. We restored the robots.txt to original version allowing robots to browse normally and pointed a few fresh links to the site. The site was back in the index within a week. If your site has thousands or millions of pages that may take a bit longer. We found that discovery through links leads to better and quicker indexation than when you simply submit to Google. Get Google Webmaster Tools account and ensure that Google has clear picture of your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I am looking for best way to block a domain from getting indexed ?
We have a website http://www.example.co.uk/ which leads to another domain (https://online.example.co.uk/) when a user clicks,in this case let us assume it to be Apply now button on my website page. We are getting meta data issues in crawler errors from this (https://online.example.co.uk/) domain as we are not targeting any meta content on this particular domain. So we are looking to block this domain from getting indexed to clear this errors & does this effect SERP's of this domain (**https://online.example.co.uk/) **if we use no index tag on this domain.
Technical SEO | | Prasadgotteti0 -
Home Page Deindexed Only at Google after Recovering from Hack Attack
Hello, Facing a Strange issue, wordpress blog hghscience[dot]com was hacked by someone, when checked, I found index.php file was changed & it was showing some page with a hacked message, & also index.html file was added to the cpanel account.All pages were showing same message, when I found it, I replaced index.php to default wordpress index.php file & deleted index.htmlI could not find any other file which was looking suspicious. Site started working fine & it was also indexed but cached version was that hacked page. I used webmaster tool to fetch & render it as google bot & submitted for indexing. After that I noticed home page get deindexed by google. Rest all pages are indexing like before. Site was hacked around 30th July & I fixed it on 1st Aug. Since then home page is not getting indexed, I tried to fetch & index multiple time via google webmasters tool but no luck as of now. 1 More thing I Noticed, When I used info:mysite.com on google, its showing some other hacked site ( www.whatsmyreferer.com/ ) When Searching from India But when same info:mysite.com is searched from US a different hacked site is showing ( sigaretamogilev.by )However when I search "mysite.com" my site home page is appearing on google search but when I check cached URL its showing hacked sites mentioned above.As per my knowledge I checked all SEO Plugins, Codes of homepage, can't find anything which is not letting the homepage indexed.PS: webmaster tool has received no warning etc for penalty or malware. I also noticed I disallowed index.php file via robots.txt earlier but now I even removed that. 7Dj1Q0w.png 3krfp9K.png
Technical SEO | | killthebillion0 -
Google webmaster⊠Zopim Live chat blocking the resources
I have noticed that Zopim Live chat blocking the resources (URLâs). What are the reasons? Now I have fetched blocked urls again for indexing purpose but still I want to know the reason. Any help from experts??? yYJJ8oM.jpg
Technical SEO | | udistm0 -
Should I block Map pages with robots.txt?
Hello, I have a website that was started in 1999. On the website I have map pages for each of the offices listed on my site, for which there are about 120. Each of the 120 maps is in a whole separate html page. There is no content in the page other than the map. I know all of the offices love having the map pages so I don't want to remove the pages. So, my question is would these pages with no real content be hurting the rankings of the other pages on our site? Therefore, should I block the pages with my robots.txt? Would I also have to remove these pages (in webmaster tools?) from Google for blocking by robots.txt to really work? I appreciate your feedback, thanks!
Technical SEO | | imaginex0 -
Do I have a chance to recover from penguin?
Hello All, I am an internet retailer www.giftbasket4kids.com  hit by Penguin and have made many changes to my site since first being hit on May 2011. It seems I lost my ranking in some keywords on the two following landing pages. I am OK on my other keywords /landing pages. http://www.giftbasket4kids.com/shop-by-category/gift-basket.html  keyword âGift Basket Ideasâ http://www.giftbasket4kids.com/pages/birthday-gifts.html Keywords âBirthday gift for kids, boys, Girls, Childrenâ it seems all keyword that includes âGift, Giftsâ and âbirthdayâ. Note: sometime most of the lost keywords come to 2<sup>nd</sup> page for a day or two then they disappear again I received a Google notice first week of August that there are unnatural links pointing to my site. There was couple of paid banner advertising. I stopped the links and request reconsideration. A week later I got response that there are still unnatural link pointing to the site. I request for reconsideration again and asked Google to let me know which links are in question.it is over 3 weeks I did not get  answer yet as I suspected. I have optimized most of my product (80 fresh content well optimized product pages) and added a lot new content. I am making links differently. I am using Squidoo lens to promote my products. I do not know what else I can do.  I have been told maybe I should restart new site! All my other keywords are ok . I do not want to start over. Can I make new landing pages and promote them? Would it work or the site is penalized for those keywords? I appreciate your advice in advance. If anyone knows of recoveries of a site like mine? I am looking for an SEO who has experience with relates to sites like mine. Do I have a chance to recover from penguin?
Technical SEO | | giftbasket4kids0 -
How to search HTML source for an entire website
Is there a way for me to do a "view source" for an entire website without having to right-click every page and select "view source" for each of them?
Technical SEO | | SmartWebPros0 -
How to prevent directory from being accessed by search engines?
Pretty much as the question says, is there any way to stop search engines from crawling a directory? I am working on a Wordpress installation for my site but don't want it to be listed in search engines until it's ready to be shown to the world. I know the simplest way is to password-protect the directory but I had some issues when I tried to implement that so I'd like to see if there's a way to do it without passwords. Thanks in advance.
Technical SEO | | Xee0