Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
My website is penalized from google with no message in GWT.
-
On 26 of October 2018 My website have around 1 million pages indexed on google. but after hour when I checked my website was banned from google and all pages were removed. I checked my GWT and I did not receive any message. Can any one tell me what are the possible reasons and how can I recover my website? My website link is https://www.whoseno.com
-
Would you be able to send me a dm with a copy of that email? I'm interested in larger sized automatic sites and trying to figure out where the limit is (and how yours isn't allowed when others are)
-
Thank you for your responses. I just received email from google after 3 days with the reason. They are saying you website is generating automatic content.
-
This is a really fascinating question. It's highly irregular for Google to de-list a site with absolutely no reason given. Even if it's something really bad like serving malware to Google's users, you usually get a hacked content notification
Your assertion that your site has been de-listed by Google due to data you are seeing in various analytics packages is backed up by Google's front-end:
- https://www.google.co.uk/search?q=site%3Awhoseno.com
- https://www.google.com/search?q=site%3Awhoseno.com
- https://www.google.fr/search?q=site%3Awhoseno.com
- https://www.google.bg/search?q=site%3Awhoseno.com
I can't find any pages from your site in Google US, UK, France or Bulgaria. Whatever has happened they seem to have gone fairly thermonuclear!
I performed a 25% crawl of your site using Screaming Frog (rendering / JS enabled), using Google's user agent (Googlebot). Some pages returned an error 404:
- https://www.whoseno.com/number-information
- https://www.whoseno.com/whose-number-is-this
- https://www.whoseno.com/track-location
- https://www.whoseno.com/get-mobile-number-details
- https://www.whoseno.com/phone-number-details
- https://www.whoseno.com/get-complete-details-of-your-ex
- https://www.whoseno.com/track-any-mobile-number
- https://www.whoseno.com/wrong-number
- https://www.whoseno.com/whose-number-is-this-calling-me
- https://www.whoseno.com/phone-number-search
- https://www.whoseno.com/recent-lookups-on-whoseno
- https://www.whoseno.com/get-details-of-any-mobile
- https://www.whoseno.com/get-details-of-any-phone-number-for-free
- https://www.whoseno.com/trace-location-on-map
- https://www.whoseno.com/reverse-directory
- https://www.whoseno.com/track-location-by-phone-number
- https://www.whoseno.com/reverse-phone-lookup
- https://www.whoseno.com/phone-number-lookup
- https://www.whoseno.com/reverse-phone-lookup-service
Although this seems like quite a few broken pages, there were many more which were rendering properly. This just looks like the kind of stuff which Google would flag as crawl errors, rather than taking a site down in its entirety when the majority of pages return 200 (OK).
Some of the URLs like, getting "complete details about your ex" Google may frown upon. People shouldn't really be able to go on a site and get complete details for their ex-partner as that promotes stalking (something which Google is firmly against, and which most first-world governments are moving to take more and more action on). Even if the name of the page is misleading and it doesn't (when working) really supply that functionality, that then makes it a spam page instead (as it looks to satisfy unscrupulous users looking for such information and then fails to deliver).
Out of the pages which are returning 200 (OK), most of them are individual phone number pages. An example might be this page: https://www.whoseno.com/US/2014623561 - the number has been publicly logged as spam. With the advent of GDPR legislation, if you are logging phone numbers and publicly keeping a database of them (without the permission of the phone number's owner) then you may be in breach of new European GDPR legislation (read about it here).
Google wants to continue operating in Europe, so whilst they may be an American company GDPR does heavily impact Google. They want to comply with GDPR
I checked the technical indexation of your pages, there don't seem to be any huge red flags.
- Robots.txt isn't blocking critical pages and resources
- Nor is the Meta no-index tag
- Canonical tags don't seems to be de-indexing real pages and pointing Google to broken ones
- Google's user-agent seems to be able to access most pages properly
I decided to search for your site on Bing to see if they had also de-indexed you:
Bing still holds pages and records of your domain.
One of the results really interested me. There's a Twitter profile listed on those search results, the SERP snippet reads like this:
"Hussɑin Aвduℓℓɑtif (@whoseno) | Twitter
The latest Tweets from Hussɑin Aвduℓℓɑtif (@whoseno_)"_
The Twitter profile has been suspended. This may or may not be your Twitter profile. If it's not your Twitter profile, your digital identity may have accidentally been combined with this person's who may or may not have Twitter ToS or state-level action against them
You need to go to Google's Webmaster support forum here and ask them what the deal is.
It's unlikely to be Penguin / link related and I don't think it's tech related either. It could be GDPR concerns, pollution of your digital identity - combined with a 3rd party who has state-level action against them, or it could be a basic 'Google glitch'
-
Ok, this one may be interesting, if it's none of these options below I'd love to take a deeper look, send me a dm on twitter: https://twitter.com/thomasharvey_me
So, I see that you're on Cloudflare, are you still being crawled by Google?
Have you looked in the old search console? Have you or anyone you work with done anything in the "remove urls" section?
Have you seen any change in crawl stats recently?
Any recent changes to the site that may have caused this?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Staging website got indexed by google
Our staging website got indexed by google and now MOZ is showing all inbound links from staging site, how should i remove those links and make it no index. Note- we already added Meta NOINDEX in head tag
Intermediate & Advanced SEO | | Asmi-Ta0 -
Website ranking stuck on 2nd page of google. How to bring it in top 10 position??
Hi I am working on a site indianhomeappliances.in that for search terms such as 'best washing machine in india' appears near the top of the 2nd page of Googl for url https://indianhomeappliances.in/best-washing-machine-in-india/ When looking at what is listed on the 1st page for 'best washing machine in india' I would appreciate any advice/guidance on what else could be done to give the site a final push to get on the 1st page of search results. I have made more than 60 backlinks along with sites from competitor analysis via moz for this page Looking at the sites that are on the 1st page I cant understand why many of them are ranking higher than me? Any insight and plan of attack would be most appreciated from any search experts on the forum. My website is 2.5 months old. Many Thanks
Intermediate & Advanced SEO | | Pank00770 -
SEO on dynamic website
Hi. I am hoping you can advise. I have a client in one of my training groups and their site is a golf booking engine where all pages are dynamically created based on parameters used in their website search. They want to know what is the best thing to do for SEO. They have some landing pages that Google can see but there is only a small bit of text at the top and the rest of the page is dynamically created. I have advised that they should create landing pages for each of their locations and clubs and use canonicals to handle what Google indexes.Is this the right advice or should they noindex? Thanks S
Intermediate & Advanced SEO | | bedynamic0 -
If my website uses CDN does thousands of 301 redirect can harm the website performance?
Hi, If my website uses CDN does thousands of 301 redirect can harm the website performance? Thanks Roy
Intermediate & Advanced SEO | | kadut1 -
Does google ignore ? in url?
Hi Guys, Have a site which ends ?v=6cc98ba2045f for all its URLs. Example: https://domain.com/products/cashmere/robes/?v=6cc98ba2045f Just wondering does Google ignore what is after the ?. Also any ideas what that is? Cheers.
Intermediate & Advanced SEO | | CarolynSC0 -
If my website do not have a robot.txt file, does it hurt my website ranking?
After a site audit, I find out that my website don't have a robot.txt. Does it hurt my website rankings? One more thing, when I type mywebsite.com/robot.txt, it automatically redirect to the homepage. Please help!
Intermediate & Advanced SEO | | binhlai0 -
Best way to remove full demo (staging server) website from Google index
I've recently taken over an in-house role at a property auction company, they have a main site on the top-level domain (TLD) and 400+ agency sub domains! company.com agency1.company.com agency2.company.com... I recently found that the web development team have a demo domain per site, which is found on a subdomain of the original domain - mirroring the site. The problem is that they have all been found and indexed by Google: demo.company.com demo.agency1.company.com demo.agency2.company.com... Obviously this is a problem as it is duplicate content and so on, so my question is... what is the best way to remove the demo domain / sub domains from Google's index? We are taking action to add a noindex tag into the header (of all pages) on the individual domains but this isn't going to get it removed any time soon! Or is it? I was also going to add a robots.txt file into the root of each domain, just as a precaution! Within this file I had intended to disallow all. The final course of action (which I'm holding off in the hope someone comes up with a better solution) is to add each demo domain / sub domain into Google Webmaster and remove the URLs individually. Or would it be better to go down the canonical route?
Intermediate & Advanced SEO | | iam-sold0 -
My website (non-adult) is not appearing in Google search results when i have safe search settings on. How can i fix this?
Hi, I have this issue where my website does not appear in Google search results when i have the safe search settings on. If i turn the safe search settings off, my site appears no problem. I'm guessing Google is categorizing my website as adult, which it definitely is not. Has anyone had this issue before? Or does anyone know how to resolve this issue? Any help would be much appreciated. Thanks
Intermediate & Advanced SEO | | CupidTeam0