How do I eliminate indexed products?
-
Please help! We got clobbered by Penguin and are at risk of having to close down after 10 years. We have been trying to figure out why and believe now it might be because of duplicate content. We added 2" inserts in March (over 500):
http://www.trophycentral.com/inserts1.html
Even though each is a different products, SEOMOZ is saying they are considered duplicate content. Given the timing, we think this might be the cause, even though it is totally legitimate.
Question - since these are now indexed and since we can't easily add content quickly, what is the best way to handle this situation? A no-index tag?
Is there a way to let Google know that their algorithm is detroying legitimate businesses??
-
Got it - thanks. I will be making the changes over the next few days. Unfortunately, I published the site last night and it will take about 18 hours so I can't access it for a while.
-
Remeber 6that should be a no-index,follow not a no-index,no-follow
-
Thanks, Alan. I had put a no-index, no-follow on the main category (inserts1.html) so that google could not get to the individual products to index them. That was the quickest thing I could do given how many products I need to update. Based on your note though, I will go through the individual products with a no-index, but it will take some time. Thanks again!
-
I can see them now - THANK YOU!!!
-
If they are noindex, then it should not be problem, but i would not no-follow as all links pointing the the no follow pages will waster their link juice, if you have no-index follow then the link jucie will flow back out of the no-indexed pages.
but having a look at the page, i can not see any no-index tag in the page
-
site:trophycentral.com -www shows all content indexed not within the www subdomain.
-
Sorry to bother you again - last question - I promise! Where did you see the mobile.trophycentral.com pages indexed? I when on to google and didn't see them in the main index. Thanks!
-
Alan, thank you! I just sent a note to the programmer who created the mobile site. For now, I am going to have them get it out of the index and I have stopped the redirection so that there is no mobile site. This may not be the best thing for the long-run, but for now I can at least be sure I fix the mobile issue. I have also fixed the strictlygifts linking. Working on removing more duplicate content now.
Thanks again!
-
This is a sad reality that many business owners face. SEO is a very complex process and unfortunately it's a case of two-fold barriers to success.
On the one hand, not all SEO's really know, or even if they do, don't consider long-term ramifications of what they might be recommending. Many of us in the industry think and act otherwise, however it is a problem nonetheless.
On the other hand, Google constantly changes their rules to a certain extent - as more people look for ways to game the system, what may have been acceptable previously can become unacceptable as Google tries to clean up the mess. It's a vicious circle.
So...
You can get "rid" of indexed pages by blocking them through a robots.txt file - if there are patterns to their URLs. if it's an entire site, you can block the whole site in one line in the robots.txt file. If it's multiple sections of a site, you can block entire sections while leaving other sections open for search indexing. A professional should be tapped to help you with that.
Its important to consider whether pages should be blocked, or instead, redirected to other pages that you want indexed or are indexed that are similar in nature.
Bad link evaluation is a professional process and should not be undertaken lightly. In many cases, site owners will ignore your requests, so it's important to at least get the request process right and to document the process. Again, a professional is needed for that.
And yes, you can submit a request after that's done.
Unfortunately, anyone you task to do the work that would be able to help you will both charge you for their time and cannot guarantee that what is done will be enough. It's another reality of the world we operate in because Google cannot reveal trade secrets to help you know what exactly needs to be done.
-
Alan, thank you so much for this. I am the founder of the business and not a webmaster, so parden these questions:
1. I originally thought it was the mobile site that caused this given the timing, but was told that somehow google was on the lookout for mobile.xxx and that it was not an issue.** I am sure you are right! How can I get rid of the indexed pages? ** I turned the mobile redirect off a couple of weeks ago so it is not even active.
2. My search provider told me they made changes to get rid of most of the pages, but since I are still seeing them, I am concerned. Is thiere something I can do to get rid of the pages?
3. I can easily change strictlygifts - this is the only thing that was intentional (but done about 8 years ago!).
4. How can I tell which are bad links - low page rank?
I have made thousands of changes based on the advice of others - improved the site speed, removed crawl errors, got rid of hundreds of pages, added duplicate content, etc. We were not given any sort of manual penalty - can I still submit a request after the above is done?
Thank you again. I have built this business over the last 10 years and to see it destroyed overnight is heartbreaking. I can't tell you how much your help is appreciated.
-
I checked a few things -you have bigger fish to fry.
Search.trophycentral.com and mobile.trophycentral.com - are either of those causing duplicate content problems on a mass scale? Google has 8k www pages indexed, and three times as many non www pages indexed.
Then looking at your inbound link profile, you've got a huge volume of inbound links from very low quality "SEO only" sites relative to your total inbound link profile. Very serious problem there.
Then you've got another site you apparently own site (StrictlyGifts.com) where you have a footer link with keywords, from every page of that site pointing to the TrophyCentral site.
The list goes on.
The cumulative impact is clearly a case of your site showing all the signs of SEO stuffing and unnatural link building. Even if some of it was unintentional (like the duplicate content conflicts across sub-domains), the pattern is clear.
1. Do all you can to get as many of the bad links removed as possible. Keep a spreadsheet of that effort.
2. Block search.trophycentral.com from search engines.
3. Either redirect mobile.trophycentral.com to the main www site and have the main www site redesigned to be flexible and responsive to different viewing platforms, or get together with a mobile SEO expert to otherwise address that duplicate content issue.
4. Add high quality unique descriptive text based content to all of your primary category and sub-category pages, and even some on every product page.
5. Consider submitting a reconsideration request to Google after you've made real headway on all of that work. Be willing to submit the spreadsheet to show links you've had removed and which you tried to but couldn't. Explain all the other steps you've taken.
You may get a bounce after that or it could just take the next Penguin update if you've done most of that before the next update.
Either way, that's just recommendations that come from only a few minutes looking at your site. There could be many other issues to address.
-
Alan, thanks. Not to sound stupid, but
1. What about the product looks like it is spam to you?
2. If I have a no index, no follow in inserts1, will that prevent goolge from all of the sub pages?
3. If the pages are already indexed, how can I get rid of them?
Sorry for the ignorant questions, but I own the business and I am not a webmaster.
Thnaks!
-
I had a quick look at this page http://www.trophycentral.com/50401.html
I found below, it is much longer thenthe sample i gave here, i would get rid of it, it looks like you are trying to spam the results
var = new Array('Have used them many times. Seamless transactions - all done through the web. Top quality product. Fast delivery. Custom engraving, including logos. Highly recommended. DR Angola, IN','This was my first order with Trophy Central, and my experience was great. I did everything on-line, the....
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google is indexing bad URLS
Hi All, The site I am working on is built on Wordpress. The plugin Revolution Slider was downloaded. While no longer utilized, it still remained on the site for some time. This plugin began creating hundreds of URLs containing nothing but code on the page. I noticed these URLs were being indexed by Google. The URLs follow the structure: www.mysite.com/wp-content/uploads/revslider/templates/this-part-changes/ I have done the following to prevent these URLs from being created & indexed: 1. Added a directive in my Htaccess to 404 all of these URLs 2. Blocked /wp-content/uploads/revslider/ in my robots.txt 3. Manually de-inedex each URL using the GSC tool 4. Deleted the plugin However, new URLs still appear in Google's index, despite being blocked by robots.txt and resolving to a 404. Can anyone suggest any next steps? I Thanks!
Technical SEO | | Tom3_150 -
Indexing Issue
Hi, We have moved one of our domain https://www.mycity4kids.com/ in angular js and after that, i observed the major drop in the number of indexed pages. I crosschecked the coding and other important parameters but didn't find any major issue. What could be the reason behind the drop?
Technical SEO | | ResultFirst0 -
Homepage not indexed - seems to defy explanation
Hey folks Hoping to get some more eyes on a specific problem I am seeing with a clients site. Site: http:www.ukjuicers.com We have checked everything we can think of and the usual suspects here are not present: Canonical URL is in place Site is shown as indexed in search console No Crawl, DNS, Connectivity or server errors No robots.txt blocking - verified in search console No robots meta tags or directives Fetch as Google works Fetch & render works site command returns all other pages info command does not return the homepage homepage is cached and cache has been updated since this issue started: http://webcache.googleusercontent.com/search?q=cache:www.ukjuicers.com homepage is indexed in yahoo and Bing all variations redirect to the www.ukjuicers.com domain (.co.uk, .com, www, sans www etc) The only issue I found after some extensive digging was some issues with the HTTP and HTTPS versions of the site both being available and both specifying the canonical version as themselves. So, http site used canonicals with http and https site used canonicals with https. So, a conflict there with the canonical exacerbating the problem it is there to solve. The HTTPS site is not indexed though and we have set this up in webmaster tools and now the web developer has set redirects to ensure all versions even the https now 301 redirect to the http://www.ukjuicers.com page so these canonical issues have been ironed out. But... it's still not indexing the homepage. The practical implications of this are quite scary - the site used to be somewhere between 1st and 4th for keywords like 'juicers', 'juicer' etc. Now they are bottom of page 1 or top of page 2 with an internal page. They were jostling with the big boys (amazon, argos, john lewis etc) but now they are right at the bottom of the second page. It's a strange one - i have seen all manor of technical problems over the years but this one seems to defy sensible explanation. The next step is to do a full technical SEO audit of the site but I am always of the opinion that with many eyes all bugs are shallow so if anyone has any input or experience with odd indexation problems like this would love to get your input. Cheers
Technical SEO | | Marcus_Miller
Marcus0 -
Google is not indexing my new URL structure. Why not?
Hi all, We launched a new website for a customer on April 29th. That same day we resubmitted the new sitemap & asked Google to fetch the new website. Screenshot is attached of this (GWT Indexed). However, when I look at Google Index (see attachment - Google Index), Automated Production's old website URL's still appear. It's been two weeks. Is it normal for Google's index to take this long to update? Thanks for your help. Cole VoLPjhy vfxVUsO
Technical SEO | | ColeLusby0 -
How To Cleanup the Google Index After a Website Has Been HACKED
We have a client whose website was hacked, and some troll created thousands of viagra pages, which were all indexed by Google. See the screenshot for an example. The site has been cleaned up completely, but I wanted to know if anyone can weigh in on how we can cleanup the Google index. Are there extra steps we should take? So far we have gone into webmaster tools and submitted a new site map. ^802D799E5372F02797BE19290D8987F3E248DCA6656F8D9BF6^pimgpsh_fullsize_distr.png
Technical SEO | | yoursearchteam0 -
Dev Site Was Indexed By Google
Two of our dev sites(subdomains) were indexed by Google. They have since been made private once we found the problem. Should we take another step to remove the subdomain through robots.txt or just let it ride out? From what I understand, to remove the subdomain from Google we would verify the subdomain on GWT, then give the subdomain it's own robots.txt and disallow everything. Any advice is welcome, I just wanted to discuss this before making a decision.
Technical SEO | | ntsupply0 -
Single URL not indexed
Hi everyone! Some days ago, I noticed that one of our URLs (http://www.access.de/karriereplanung/webinare) is no longer in the Google index. We never had any form of penalty, link warning etc. Our traffic by Google is constantly growing every month. This single page does not have an external link pointing to it - only internal links. The page has been indexed all the time. The HTTP status code is 200, there is no noindex or something in the code. I submitted the URL on GWMT to let Google send it to the index. It was crawled successfully by Google, sent to the index 5 days ago - nothing happened, still not indexed. Do you have any suggestions why this page is no longer indexed? It is well linked internally and one click away from the home page. There is still the PR of 5 showing, I always thought that pages with PR are indexed.......
Technical SEO | | accessKellyOCG0 -
Duplicate Content - Products
When running a report it says we have lots of duplicate content. We are a e-commerce site that has about 45,000 sku's on the site. Products can be in multiple departments on the site. So the same products can show up on different pages of the site. Because of this the reports show multiple products with duplicate content. Is this an issue with google and site ranking? Is there a way to get around this issue?
Technical SEO | | shoedog1