Site dropped suddenly. Is it due to htaccess?
-
I had a new site that was ranking on the first page for 5 keywords.
My site was hacked recently and I went through a lot of trouble to restore it. Last night, I discovered that my site was nowhere to be found but when i searched site: mysite.com, it was still ranking which means it was not penalized.
I discovered the issue to be a .htaccess and it have been resolved. My question is now that the .htaccess issue is resolved , will my site be restored back to the first page? Is there additional things that i should do? I have notified google by submitting my site
-
Any help will be good?
-
How can i verify if it's penalized or a Google dance? Because its too coincidental that the entire site got de-indexed after the site got hacked. What can i do now? I still believe that it is still getting indexed by Google but GWT told me that Google have already indexed it. Maybe its because i just refused to believe the hard truth. What can i do now?
-
There are many types and degrees of penalization. Very very few penalties result in total de-indexation.
Most of the time, if you are penalized, your rankings will simply drop for most keywords, but Google will often keep most of your pages in it's index.
Additionally, Google will only send messages about unnatural links via webmaster tools if it's a manual penalty. Algorithmic penalties, like Panda and Penguin, usually are not accompanied by manual notices.
Here's a really good article from Ryan Kent about the topic:
http://www.seomoz.org/blog/identifying-link-penalties-in-2012
There's one final possibility: Nothing is wrong with your site, but for some reason Google is devaluing your backlinks. This sometimes happens when your site is fine, but the sites linking to you get hit with a penalty. Happens more and more these days.
-
Is it possible to call Google?!?!
-
Hi
1. There is no malware on my site. I have triple checked on Succuri and in GWT
2. Sitemap was re-submitted yesterday. No point in re-doing it. I even changed my robots.txt as per comments above.
3. I re-did a Fetch as Googlebot . No issues here
4. If i have been penalized, I wont even be able to see my site when i googled my site name. Additionally, i did not receive any messages from Google. Whatever SEO methods I did for this site, i used on my other sites and the other sites are all sitting on the first page. Only this site! Damn, why am i so unlucky?
-
Hi Eada,
Sorry to hear you're having trouble. I won't go over the same ground that the others have already covered here, but let me offer these suggestions.
Google often serves results from different data centers, and those data centers refresh at different times. Also, rankings can fluctuate greatly even throughout a single day. For this reason it's not unusual to occasionally see huge swings in rankings from hour to hour as the SERPs adjust. But let's try to get to the heart of the problem.
1. If you're site was hacked, this could be a strong signal to Google to not show you in search results.
Check in Google Webmaster Tools under "Health > Malware" to see if they have detected Malware on your site.
(I stated the next 2 earlier, but here they are again)
2. Submit a new sitemap via Google Webmaster Tools. Make sure the sitemap is up to date. If your sitemap hasn't changed, resubmit it.
3. Do a "Fetch as Googlebot" - also in Webmaster Tools. Fetch your homepage. Then chose the option that says "Submit to index and all linked pages"
If Google has trouble fetching your homepage or any other page, it could indicate other problems you need to address.
4. Finally, we need to consider the possibility that this has nothing to do with hacking or .htaccess files, but instead there is the possibility that you have indeed been penalized and Google has dropped your rankings.
Have you done any questionable link building? Recieved any messages of unnatural links? If so, this may be another area you want to explore.
Hope this helps! Best of luck with your SEO.
-
Hi Eada,
There's 2 things you want to do here to "help" Google re-crawl your site.
1. Submit a new sitemap via Google Webmaster Tools. Make sure the sitemap is up to date. If your sitemap hasn't changed, resubmit it.
2. Do a "Fetch as Googlebot" - also in Webmaster Tools. Fetch your homepage. Then chose the option that says "Submit to index and all linked pages"
An engineer at Google suggested #2 to me after my own site was hacked and I cleaned it up. It's a signal to Google to take another look at those pages.
-
Its strange! How can my website dropped suddenly in ONE hour?
1. Site was de-indexed due to .htaccess . It was resolved
2. Site was back up on the first page within two days
3. Site was de-indexed within an hour.
What happened? How did it get de-indexed so quickly? I don't think Google's penalty even worked so fast? What is happening man?
-
Hi
Thank you!
I have changed robots.txt as suggested and as mentioned, I have no choice but to wait
Im really praying that this goes back up
-
-
I have some good news and some bad news. The good news is you show up fine in Yahoo and Bing unfortunately you have to click one more button to show perfectly in Google. However I'm using the tool that I strongly strongly suggest that you use
Screaming frog spider SEO
http://www.screamingfrog.co.uk/seo-spider/user-guide/
100% free for windows, Mac and Linux up to 500 pages per domain it tells you everything listed in the URL above. And will actually check your index status if you right-click on the a link that you want checked.
I believe that it is a matter of time however I would adjust your robot text to suit the information found at yoast.com below and in addition to that I would add your site map
so your robot text looks like this.
I would change my robot text to
User-Agent: *
Disallow:Sitemap: http://www.example.com/sitemap.xml
In addition I have to go to work honestly or I am dead however I believe the frog spider will help you very much and if you add the site map to the robot text that never will hurt.
I will private message you regarding one other issue I don't know if you want talk about here.
your robot text is giving me some issues. But it may not be this.
http://tools.seobook.com/robots-txt/analyzer/
Your current robot text is this below I hope this is okay to share I don't think it'll violate any trust or anything like this it's not showing the site
User-agent: *
Disallow: /wp-admin/
Disallow: /wp-includes/try out this tool as well
http://phpweby.com/services/robots
I would change my robot text to
User-Agent: *
Disallow:Sitemap: http://www.example.com/sitemap.xml
having the site map in helps a lot and if you have a /
Google tends to block more things. That are not listed below such as the site map
I also believe what this has to say is correct
http://yoast.com/example-robots-txt-wordpress/
also see
http://stackoverflow.com/questions/13527529/robots-txt-is-blocking-wordpress-site-from-google?rq=1
-
On Google Webmaster Tools, the last updates was 6th April. Today is 9th April. Why did it stopped updating? Is there something wrong?
-
Cloudfare doesnt seem to serve my purpose. It seems to be able to detect hackers and spammers but my concern is on telling Google to index my site and put me back where I am originally was.
I have checked that on this site, there is no malware and no no-follows. The strangest thing is why did it suddenly go back to where it was and one hour later, it dropped?
-
I PMED you the link. Didnt want to put it publicly as this is for a client
-
I'm going to tell you something that work for friend that is a real oddball. Cloudflare.com the company that supposedly offers you a free CDN that I would not really count as a true CDN but will keep your site safer and possibly speed up depending on the configuration. Does submit your site to Google and did help a friend of mine. This is a last ditch effort however I know it did work so I don't think couldn't in the future and if you're not using a good anycast DNS system is really no harm in using it.
Thanks for the PM will check ASAP
-
will you share the URL of us?
-
Francisco,
outstanding idea. I mixes one up with one that I actually give the same advice to. I would check Google Webmaster tools in addition to that I would check your sites domain name using Sucuri I feel there are one of the best in the business and 100% free to check your site for problems. If there are issues I would suggest using them as well as they are merely $89 a year per site. You can use the URL below to scan your website and make sure there's no malware offending Google.
http://sitecheck.sucuri.net/scanner/
sincerely,
Tom
-
Results from no index
Total amount of pages found on "site.com" with the noindex and/or nofollow meta tag is 0
I assumed that the above is good? Additionally, I have no malware. Succurri results were good.
-
No, i used Firefox which is specially for checking results. I do not use it to surf the website and i make sure it is never signed in to any Google accounts and history is never remembered.
How do I know if the .htaccess is correct? How is it possible to be back on the first page and within one hour, everything disappears?
I do not believe that i am being penalized as I am still showing up in results when keyed in the company name
-
do you feel comfortable sharing the URL with us?
How did the results of using http://www.noindexchecker.com/
end up?
if you do not feel comfortable sharing the URL you can always private message us I know that is true for me.
I think Francisco is most likely right and it is just Google has not come back and index the site yet. Because of the large amount of sites out there who will takes a bit every once in a while to properly index your website.
Here is some information on how to get your website indexed faster.
I would definitely read
one word of caution kiss metrics is my favorite analytics tool and I believe very trustworthy. However in this article they encourage one to use certain web directories. I would not do the web directories that are not relevant to your site or are not recommended on SEOmoz everything else in the article I highly agree with I just wanted to give this disclaimer
I would not do what it says underneath here italic bold I underlined
other than what is directly below this aside from the link I think everything in here is exactly what you need to do
http://blog.kissmetrics.com/get-google-to-index/
kissmetrics.com is used by companies like distilled.net so they are not a hack company or anything to be wary of
- Submit to Blog Directories – TopRank has a huge list of sites you can submit your RSS feed and blog to. This will help you build even more incoming links. If you aren’t ready to do them all, at least start with Technorati as it is one of the top blog directories. Once you have a good amount of content, also try Alltop.
here is my list of links to get your site back on top.
http://blog.kissmetrics.com/get-google-to-index/
http://searchenginewatch.com/article/2198245/How-to-Force-Google-to-Recrawl-Your-Site
https://www.google.com/webmasters/tools/submit-url?pli=1
http://yoast.com/how-to-get-google-to-crawl-your-site-faster/
I apologize that I could not write more guys however I have a huge business meeting today and the fact that I will be tested today big-time does not give me much time to response unfortunately however I will when I can. I can tell you from experience that I had an intern do some updates on the site. Found out my site was not ranking for what it should be ranking for did a quick scan of the site found a bunch of no follows and no index within approximately 5 days the site was back to where it was prior to the abrupt change.
Sincerely and best of luck,
Tom
-
If it's not a robots.txt or htaccess issue, then check GWT for malware.
If you are getting de-indexed, maybe your browser is remembering (cache) you queries. You sure you didn't write the .htacess the wrong way?
Contact Ryan Kent if you believe you need some link penalty removals.
-
Guys, please help me to figure out what could be wrong!
Today, I saw that all of the keywords was back on the first page and i was very happy. But within an hour, everything got de-indexed again! What happened? What could be the issue?
-
Manually add the URLs into GWT. You can do about 500, I think.
-
The .htaccess is solved and ive got several sites where i used the same SEO methods on all sites. My other sites are sitting safely on the first page. I strongly believe it was due to .htaccess which couldnt find the site and de-indexed my site. How can i force Google to crawl my sites and place me back on first page?
-
I would wait until the next crawl. Check your GWT to see when the last crawl was. Also, they may be taking their time to see if your site will disappear again. Make SURE it's up and running and no 404s.
I think you'll be okay if you have a good link profile.
-
Have a site that currently was ranking well for 5 of your chosen keywords.
Were the keywords exact match to the domain?
When you say the new site how new are we talking about?
You put this under black hat white hat please don't take offense to this, but is there anything you want to tell me that you've done to the site that Google might not like?
When you are hacked did you completely clean up everything are you certain it is clean? If not please run your domain through this and tell me if you get any thing like black listing or something similar to tell if there is anything negative from a hack still affecting your website please use the link below type your domain name and and and enter allow it to process
After that please use this tool and remember it takes a little bit so don't. Refresh or the back button unless you're certain it is done. This will tell us rather not your site has been told to blocked access to Google bot
http://www.noindexchecker.com/
If it is still coming up short organ want to check your through your redirects
http://www.internetofficer.com/seo-tool/redirect-check/
if you find something you don't like please use one of the tools below to generate the correct redirects
than if after this I found I needed to create a 301 I would use one of the tools below
http://www.rapidtables.com/web/tools/redirect-generator.htm
http://www.htaccessredirect.net/
can you tell me what type of site it is a WordPress, HTML that type of thing?
Without your domain name or more information all I can do is give you tools to gather information
depending on what type of website you have this may be of some use to you as well
http://www.seoverflow.com/setting-up-301-redirects-for-dynamic-urls/
sincerely,
Tom
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Infinite Scrolling on Publisher Sites - is VentureBeat's implementation really SEO-friendly?
I've just begun a new project auditing the site of a news publisher. In order to increase pageviews and thus increase advertising revenue, at some point in the past they implemented something so that as many as 5 different articles load per article page. All articles are loaded at the same time and from looking in Google's cache and the errors flagged up in Search Console, Google treats it as one big mass of content, not separate pages. Another thing to note is that when a user scrolls down, the URL does in fact change when you get to the next article. My initial thought was to remove this functionality and just load one article per page. However I happened to notice that VentureBeat.com uses something similar. They use infinite scrolling so that the other articles on the page (in a 'feed' style) only load when a user scrolls to the bottom of the first article. I checked Google's cached versions of the pages and it seems that Google also only reads the first article which seems like an ideal solution. This obviously has the benefit of additionally speeding up loading time of the page too. My question is, is VentureBeat's implementation actually that SEO-friendly or not. VentureBeat have 'sort of' followed Google's guidelines with regards to how to implement infinite scrolling https://webmasters.googleblog.com/2014/02/infinite-scroll-search-friendly.html by using prev and next tags for pagination https://support.google.com/webmasters/answer/1663744?hl=en. However isn't the point of pagination to list multiple pages in a series (i.e. page 2, page 3, page 4 etc.) rather than just other related articles? Here's an example - http://venturebeat.com/2016/11/11/facebooks-cto-explains-social-networks-10-year-mission-global-connectivity-ai-vr/ Would be interesting to know if someone has dealt with this first-hand or just has an opinion. Thanks in advance! Daniel
White Hat / Black Hat SEO | | Daniel_Morgan1 -
Direct Traffic has Dropped 48% to Last Year
Since February of 2013 our organic traffic at http://www.weddingshoppeinc.com had been declining. We were able to get traffic back up to par with numbers from the previous year by December of 2013. In March of 2014 our direct traffic took a major hit and hasn’t improved. We know our mobile traffic is part of the problem, but the issue has affected traffic from desktop and mobile devices. Is this an organic traffic problem, or is our decrease in direct traffic coming from somewhere else? Has anyone else seen this issue, or does anyone have advice? Here is what we’ve already looked into and updates to note: Before this issue, when we compared organic and direct traffic, direct was usually half of what organic was (i.e., if organic was at 10 visitors, direct was at 5). However organic traffic has followed normal trends and direct has dropped. In August we updated our .net code to MVC to drop our first byte from 1,700 to 300 milliseconds. However, if you look at our m. site, it’s around 1,000 milliseconds. We changed our SEO strategy in May to follow best practices. We’ve been rewriting old content. We haven’t ever done any black hat SEO, just have some old blogs from 2010-2012 that have too many keywords. These are getting edited. In March we moved our images to a CDN for our images. We’re currently working on server errors and broken links, but nothing significant changed around March to affect our traffic. Very recently, our web developers said that they believed our direct traffic had been getting tracked wrong in Google Analytics prior to March 2014. However they think they fixed the issue in a March push. We've taken this theory into account, but we also see a drop in revenue at the time of their push that correlates with the drop in traffic, so we know there’s a bigger issue. Any input you can provide would be greatly appreciated!
White Hat / Black Hat SEO | | JimmyFritz1 -
Rank drop ecommerce site
Hello, We're going to get an audit, but I would like to hear some ideas on what could cause our ranking drop. There's no warnings in GWT. We deleted 17 or so blogs (that had no backlinks pointing to these blogs and were simply for easy links) last summer thinking that they weren't white hat so we had to start eliminating them. At the same time, we eliminated a few sitewide paid links that were really strong. With all of this deletion, our keywords started to drop. For example, our main keyword went from first to third/fourth. With the deletions, our keywords dropped immediately a couple of spots, then with no more deletions, all of our keywords have been slowly dropping over the last seven months or so. Right now we are at the bottom of the first page for that same main keyword, and other keywords look similar. We have 70 linking root domains, of which: 15 are blogs with no backlinks that were created simply for the purpose of easy links. We didn't delete them all yet because of the immediate ranking drop when we deleted the last ones. One PR5 site has links to our home page scattered throughout it's lists of resources for people in different states in the US. It doesn't look like a standard paid link site, but it has many paid links in it's different pages. One PR4 site has our logo with another paid link logo at the bottom of one of it's pages. There are 2 other paid links from two PR4 sites that look editorial. There are other links on the sites to other websites that are paid. All links for these 2 sites look editorial. That's all the bad stuff. Other things that could be causing drop in rank - > Our bread crumbs are kind of messed up. We have a lot of subcategory pages that rel=cononical to main categories in the menu. We did this because we had categories that were exactly the same. So you'll drill down on a category page and you'll end up on a main category. To the average user, it seems perfectly fine. Our on-site SEO still has a few pages that repeat words in the titles and h1 tags several times (especially our #1 main keyword), titles similar to something like: running shoes | walking shoes | cross-training shoes where a word is repeated 2 or 3 times. Also, there are a few pages that are more keyword stuffed than we would like in the content. Just a couple of paragraphs but 2 keywords are dispersed in them three times each. The keywords in this content is not in different variations, it's exactly the keyword. We've still got a few URLs that are keywords stuffed with like 3 different keywords. We may have many 404 errors (due to some mistakes we made with the URLs in our cart) - if Google hasn't deindexed them all then we could have dozens of 404s on important category pages. But nothing is showing up in GWT. Our sitemap does not include any broken links. Google is confused about our branding it seems. I'm adding branding to the on-site SEO but right now Google often shows keywords as our branding when Google changes the way the title tag is displayed sometimes in the search engines. We don't link out to anyone. We have lots of content, almost no duplicate content, and some authoritative very comprehensive articles. Your thoughts on what to do to get our rankings back up?
White Hat / Black Hat SEO | | BobGW0 -
Site Search external hosted pages - Penguin
Hi All, On the site www.myworkwear.co.uk we have a an externally hosted site search that also creates separately hosted pages of popular searches which rank in Google and create traffic. An example of this is listed below: Google Search: blue work trousers (appears on front page of Google) Site Champion Page: http://workwear.myworkwear.co.uk/workwear/Navy%20Blue%20Work%20Trousers Nearest Category page: http://www.myworkwear.co.uk/category/Mens-Work-Trousers-936.htm Could this be a penalisation or duplication factor? Could these be interpreted as a dodgy link factor? Thanks in advance for your help. Kind Regards, Andy Southall
White Hat / Black Hat SEO | | MarzVentures0 -
How should I look to gain traffic for a blog hosted on our own site?
Ok I know what you're going to say.. social media etc right? The problem is we do that already but we're stuck in an industry that just isn't very sexy! People reading twitter/facebook don't want to read about toilets in their spare time, or keep it as a hobby. If you search bathroom blog (uk google), you will see we are about 5th, it gets us no traffic, as I imagine it's not a popular term so I can see you starting to ask why we write a blog in the first place. We write the blog because at the moment the whole industry is dominated by pile it high sell it cheap online stores and all their blogs are written for google only so finding decent or unbiased advice is rare. Seriously, these guys are creating fake blogs and paying for links inside other blogs all over the place in order to boost their rankings so we figure if you really want some good advice people can't find it. If they find our blog they will get some good advice and good content.. and then the hope is that they give us a call and we can see if we can help them. The problem is these guys are hogging all the keywords.. and it seems the bathroom industry has very few keywords that people search! Now I know we are in it for the long haul.. so taking time doesn't bother me, but I was wondering if there were any tried and tested places to post a blog that could get us at least seen so that people could see how different our content is? Or if all else fails, can anyone suggest the right keywords to aim at besides the "bathroom suites" etc that these huge online stores dominate?
White Hat / Black Hat SEO | | willryles0 -
Beating the file sharing sites in SERPs - Can it be done and how?
Hi all, A new client of mine is an online music retailer (CD, vinyls, DVD etc) who is struggling against file sharing sites that are taking precedence over the client's results for searches like "tropic of cancer end of things cd" If a site a legal retailer trying to make an honest living who's then having to go up against the death knell of the music industry - torrents etc. If you think about it, with all the penalties Google is fond of dealing out, we shouldn't even be getting a whiff of file sharing sites in SERPs, right? How is it that file sharing sites are still dominating? Is it simply because of the enormous amounts of traffic they receive? Does traffic determine ranking? How can you go up against torrents and download sites in this case. You can work on the onsite stuff, get bloggers to mention the client's pages for particular album reviews, artist profiles etc, but what else could you suggest I do? Thanks,
White Hat / Black Hat SEO | | Martin_S0 -
What do Bing and Yahoo look for in a site?
Do Bing and Yahoo look for authoritative sites like google does? Do they punish sites for black hat or spamming? The reason I ask these questions is because one of my competitors was ranking in first place for many great keywords in Google, they have the highest authority out of all of their competitors. They must have been punished by Google because now they are not ranking for any great keywords in Google. However they are ranking 1st in Bing and Yahoo for most the top keywords, getting the the most visibility out of all the sites. I attached a small Graph with latest visibility for the sites with the top keywords from google and then I also included the company that was punished from google they are the green circles on the graph. dIVI4.png
White Hat / Black Hat SEO | | SEODinosaur0 -
Would linking out to a gambling/casino site, harm my site and the other sites it links out to?
I have been emailed asking if I sell links on one of my sites. The person wants to link out to slotsofvegas[dot]com or similar. Should I be concerned about linking out to this and does it reduce the link value to any of the other sites that the site links out to? Thanks, Mark
White Hat / Black Hat SEO | | Markus1111