Google: site gone from SERPs, back in 1 day, then gone again?
-
Last December we fumbled our 404 error page with a misconfigured server and broken links on the page.
Needless to say, our site dropped into an abyss - for 4 months. Yesterday we appeared again in our regular placement (actually stronger placement). Our site has been around since 09-Jan-1999 and has been a highly regarded site with good link structure and solid content for engineers.
Then today we're gone again. Yesterday morning we had 125,000 pages indexed with Google which grew to 187,000 by late afternoon. Then this morning we're nowhere to be found and only 21,800 pages are now indexed.
We've been working with Bruce Clay Inc through an SEO site audit doing several updates to improve through good seo practices. We haven't made any changes to the site since last Friday, April 13th (maybe the unlucky number has something to do with it....)
Any ideas, insight, suggestions???? Thanks!
-
Nathan please see my response to this question in the Private Q&A section. In short, I don't think this has to do with Google's goof-up a couple weeks ago, or with some of the other shifts, but I do think you are in violation of some of their guidelines on a pretty massive scale, although unintentionally and with good reason. I'll go ahead and paste my answer below, but the Private version includes links and other information that could identify the site.
Hello Nathan,
There were some pretty major shifts on the 16th, 19th and 24th-26th so the time-frame raises a red flag. However, with the little information I have (basically your indexation count) I think you may have a problem that isn't related to any of the recent algorithm shifts.
Assuming you are talking about ####.com, I show 462,000 indexed URLs from that domain. Nearly half a million URLs is quite a bit to index and you can imagine that Google might want to thin that out a bit and focus only on the ones that are important and original.
If you have 460k + pages, but most of them are duplicate content or significantly duplicate content, and most of them have no external links, this would put you in danger of being affected by several different algorithms/filters/penalties put in place by Google to keep such pages from bloating their index and outranking what they think to be "better" content.
That can be a hard pill to swallow because you know your content is good and people like what they find there. But let's look at this from the perspective of an impartial machine...
The following EXACT phrase appears, word-for-word, on about 22,800 different pages, most of them from within your site: "PHRASED REMOVED FOR PUBLIC VIEWING"
The following is typical of the "Related Terminology" section of your pages, which could be interpreted by Google as being keyword spam: "You may have searched any one of these terms to find this product: Keyword1, keyword2, keyword3, keyword4, keyword5, keyword6, keyword7, keyword8, so forth and so-on for a few dozen keywords".
A lot of these pages, possibly most of them, have very little unique/exclusive content. Instead, they list out features and uses from a database. Because of this you have many thousands of pages all with the same potential pool of words, each choosing to show more or less the same words in various orders and combinations. Furthermore, it is obvious that the pages are generated by a machine. Looking at this example, a "better" page would be one that has an introduction telling the visitor what "Polybenzimidazole (PBI) is and what it's used for in paragraph form, in addition to the list of features and uses: http://www.###.com/###/ . I'm sure most of your users will know what PBI is for if they search the site for it, but remember we're dealing with machine algorithms designed to detect spamming attempts, such as article spinning, which uses pretty much the same technique of switching around the order of words to generate hundreds or thousands of "articles" from a single original.
I wouldn't venture to provide specific advice on how to fix these issues without knowing more about your business. My suggestion is to look for a reputable outside SEO agency who can help you overcome these issues, which may involve removing a lot of pages from the index, allowing more content to be seen on each datasheet, or some other measures.
Good luck!
-
I hope they make the same mistake again - our website finally returned to normal positions in Google SERPs that we were at prior to our 404 error page mistake back in Dec. 2011.
Then yesterday, once again we've gone missing and are baffled at why and what to do... We did notice our site:www.ides.com raised from 21,800 pages yesterday to 124,000 today.
-
No, it's Google has work to do, they admitted it was their fault and something went wrong in their classifier.
-
If my site was mistaken for a parked domain.....then I have a lot of work to do. lol
-
It might actually have been Google's fault this time. They misclassified some sites as parked domains and they dropped out of the index. See the Search Engine Land post at http://searchengineland.com/dropped-in-rankings-google-mistake-over-parked-domains-118979.
-
Our representative at Bruce Clay Inc just replied with the following info, so something's up...
"We’re pretty clueless too. The whole Internet went a little crazy yesterday because of a big shakeup in Google’s results, and there are a few theories as to what exactly happened. From the forums it looked like a lot of sites lost all their rankings."
They are looking into our Google Webmaster Tools and Analytics accounts to see if they can pick up any clues.
-
We disappeared for about 16 hours yesterday completely from the SERPS then last night it popped back up and we were ranked higher for all our keywords. I deleted one duplicate page on a directory but I am not sure what transpired to cause the events. Hopefully someone else will have some input and let me know if this is a common occurrence.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved URL dynamic structure issue for new global site where I will redirect multiple well-working sites.
Dear all, We are working on a new platform called [https://www.piktalent.com](link url), were basically we aim to redirect many smaller sites we have with quite a lot of SEO traffic related to internships. Our previous sites are some like www.spain-internship.com, www.europe-internship.com and other similars we have (around 9). Our idea is to smoothly redirect a bit by a bit many of the sites to this new platform which is a custom made site in python and node, much more scalable and willing to develop app, etc etc etc...to become a bigger platform. For the new site, we decided to create 3 areas for the main content: piktalent.com/opportunities (all the vacancies) , piktalent.com/internships and piktalent.com/jobs so we can categorize the different types of pages and things we have and under opportunities we have all the vacancies. The problem comes with the site when we generate the diferent static landings and dynamic searches. We have static landing pages generated like www.piktalent.com/internships/madrid but dynamically it also generates www.piktalent.com/opportunities?search=madrid. Also, most of the searches will generate that type of urls, not following the structure of Domain name / type of vacancy/ city / name of the vacancy following the dynamic search structure. I have been thinking 2 potential solutions for this, either applying canonicals, or adding the suffix in webmasters as non index.... but... What do you think is the right approach for this? I am worried about potential duplicate content and conflicts between static content dynamic one. My CTO insists that the dynamic has to be like that but.... I am not 100% sure. Someone can provide input on this? Is there a way to block the dynamic urls generated? Someone with a similar experience? Regards,
Technical SEO | | Jose_jimenez0 -
Best Practice for Blocking a site from 1 countries search engines
A client cannot appear in any search engines in one given country but they are ok in rest of the world. Has anybody had any experience blocking a site from appearing in just google.de, bing.de and yahoo.de for example?
Technical SEO | | Salience_Search_Marketing0 -
Http and https issue in Google SERP
Hi, I've noticed that Google indexing some of my pages as regular http, like this: http://www.example.com/accounts/ and some pages are being indexed as https, like this: https://www.example.com/platforms/ When I've performed site audit check in various SEO tools I got something around +450 pages duplicated and showing me pairs of the same URL pages, one time with http and one time with https. In our site there is the possibility for people to register and and open an account, later on to login to our website with their login details. In our company I'm not the one that is responsible for the site's maintenance and I would like to know if this is an issue, and if this is an issue - to know what causing it and how to fix it so I'll be able to forward the solution to the person in charge. Additionally I would like to know in general, what is the real purpose of https vs. http and to know what is the preferred method that our website should use. Currently when URLs are typed manually to the address bar, all the URLs are loading fine - with or without https written at the start of each URL. I'm not allowed to expose our site's name, this is why I wrote example.com instead, I hope you can understand that. Thank you so much for your help and I'm looking forward reading your answers.
Technical SEO | | JonsonSwartz0 -
My beta site (beta.website.com) has been inadvertently indexed. Its cached pages are taking traffic away from our real website (website.com). Should I just "NO INDEX" the entire beta site and if so, what's the best way to do this? Please advise.
My beta site (beta.website.com) has been inadvertently indexed. Its cached pages are taking traffic away from our real website (website.com). Should I just "NO INDEX" the entire beta site and if so, what's the best way to do this? Are there any other precautions I should be taking? Please advise.
Technical SEO | | BVREID0 -
Page Indexing increase when I request Google Site Link demote
Hi there, Has anyone seen a page crawling increase in Google Web Master Tools when they have requested a site link demotion? I did this around the 23rd of March, the next day I started to see page crawling rise and rise and report a very visible spike in activity and to this day is still relatively high. From memory I have asked about this in SEOMOZ Q&A a couple of years ago in and was told that page crawl activity is a good thing - ok fine, no argument. However at the nearly in the same period I have noticed that my primary keyword rank for my home page has dropped away to something in the region of 4th page on Google US and since March has stayed there. However the exact same query in Google UK (Using SEOMOZ Rank Checker for this) has remained the same position (around 11th) - it has barely moved. I decided to request an undemote on GWT for this page link and the page crawl started to drop but not to the level before March 23rd. However the rank situation for this keyword term has not changed, the content on our website has not changed but something has come adrift with our US ranks. Using Open Site Explorer not one competitor listed has a higher domain authority than our site, page authority, domain links you name it but they sit there in first page. Sorry the above is a little bit of frustration, this question is not impulsive I have sat for weeks analyzing causes and effects but cannot see why this disparity is happening between the 2 country ranks when it has never happened for this length of time before. Ironically we are still number one in the United States for a keyword phrase which I moved away from over a month ago and do not refer to this phrase at all on our index page!! Bizarre. Granted, site link demotion may have no correlation to the KW ranking impact but looking at activities carried out on the site and timing of the page crawling. This is the only sizable factor I can identify that could be the cause. Oh! and the SEOMOZ 'On-Page Optimization Tool' reports that the home page gets an 'A' for this KW term. I have however this week commented out the canonical tag for the moment in the index page header to see if this has any effect. Why? Because as this was another (if not minor) change I employed to get the site to an 'A' credit with the tool. Any ideas, help appreciated as to what could be causing the rank differences. One final note the North American ranks initially were high, circa 11-12th but then consequently dropped away to 4th page but not the UK rankings, they witnessed no impact. Sorry one final thing, the rank in the US is my statistical outlier, using Google Analytics I have an average rank position of about 3 across all countries where our company appears for this term. Include the US and it pushes the average to 8/9th. Thanks David
Technical SEO | | David-E-Carey0 -
Has Google stopped rendering author snippets on SERP pages if the author's G+ page is not actively updated?
Working with a site that has multiple authors and author microformat enabled. The image is rendering for some authors on SERP page and not for others. Difference seems to be having an updated G+ page and not having a constantly updating G+ page. any thoughts?
Technical SEO | | irvingw0 -
Google Dmoz description in SERPS
My dmoz description is not as KW rich as my sites normal description. IS there an advantage or disadvantage to either? If so, How do I prevent google from doing this?
Technical SEO | | DavidS-2820610
