How do I eliminate indexed products?
-
Please help! We got clobbered by Penguin and are at risk of having to close down after 10 years. We have been trying to figure out why and believe now it might be because of duplicate content. We added 2" inserts in March (over 500):
http://www.trophycentral.com/inserts1.html
Even though each is a different products, SEOMOZ is saying they are considered duplicate content. Given the timing, we think this might be the cause, even though it is totally legitimate.
Question - since these are now indexed and since we can't easily add content quickly, what is the best way to handle this situation? A no-index tag?
Is there a way to let Google know that their algorithm is detroying legitimate businesses??
-
Got it - thanks. I will be making the changes over the next few days. Unfortunately, I published the site last night and it will take about 18 hours so I can't access it for a while.
-
Remeber 6that should be a no-index,follow not a no-index,no-follow
-
Thanks, Alan. I had put a no-index, no-follow on the main category (inserts1.html) so that google could not get to the individual products to index them. That was the quickest thing I could do given how many products I need to update. Based on your note though, I will go through the individual products with a no-index, but it will take some time. Thanks again!
-
I can see them now - THANK YOU!!!
-
If they are noindex, then it should not be problem, but i would not no-follow as all links pointing the the no follow pages will waster their link juice, if you have no-index follow then the link jucie will flow back out of the no-indexed pages.
but having a look at the page, i can not see any no-index tag in the page
-
site:trophycentral.com -www shows all content indexed not within the www subdomain.
-
Sorry to bother you again - last question - I promise! Where did you see the mobile.trophycentral.com pages indexed? I when on to google and didn't see them in the main index. Thanks!
-
Alan, thank you! I just sent a note to the programmer who created the mobile site. For now, I am going to have them get it out of the index and I have stopped the redirection so that there is no mobile site. This may not be the best thing for the long-run, but for now I can at least be sure I fix the mobile issue. I have also fixed the strictlygifts linking. Working on removing more duplicate content now.
Thanks again!
-
This is a sad reality that many business owners face. SEO is a very complex process and unfortunately it's a case of two-fold barriers to success.
On the one hand, not all SEO's really know, or even if they do, don't consider long-term ramifications of what they might be recommending. Many of us in the industry think and act otherwise, however it is a problem nonetheless.
On the other hand, Google constantly changes their rules to a certain extent - as more people look for ways to game the system, what may have been acceptable previously can become unacceptable as Google tries to clean up the mess. It's a vicious circle.
So...
You can get "rid" of indexed pages by blocking them through a robots.txt file - if there are patterns to their URLs. if it's an entire site, you can block the whole site in one line in the robots.txt file. If it's multiple sections of a site, you can block entire sections while leaving other sections open for search indexing. A professional should be tapped to help you with that.
Its important to consider whether pages should be blocked, or instead, redirected to other pages that you want indexed or are indexed that are similar in nature.
Bad link evaluation is a professional process and should not be undertaken lightly. In many cases, site owners will ignore your requests, so it's important to at least get the request process right and to document the process. Again, a professional is needed for that.
And yes, you can submit a request after that's done.
Unfortunately, anyone you task to do the work that would be able to help you will both charge you for their time and cannot guarantee that what is done will be enough. It's another reality of the world we operate in because Google cannot reveal trade secrets to help you know what exactly needs to be done.
-
Alan, thank you so much for this. I am the founder of the business and not a webmaster, so parden these questions:
1. I originally thought it was the mobile site that caused this given the timing, but was told that somehow google was on the lookout for mobile.xxx and that it was not an issue.** I am sure you are right! How can I get rid of the indexed pages? ** I turned the mobile redirect off a couple of weeks ago so it is not even active.
2. My search provider told me they made changes to get rid of most of the pages, but since I are still seeing them, I am concerned. Is thiere something I can do to get rid of the pages?
3. I can easily change strictlygifts - this is the only thing that was intentional (but done about 8 years ago!).
4. How can I tell which are bad links - low page rank?
I have made thousands of changes based on the advice of others - improved the site speed, removed crawl errors, got rid of hundreds of pages, added duplicate content, etc. We were not given any sort of manual penalty - can I still submit a request after the above is done?
Thank you again. I have built this business over the last 10 years and to see it destroyed overnight is heartbreaking. I can't tell you how much your help is appreciated.
-
I checked a few things -you have bigger fish to fry.
Search.trophycentral.com and mobile.trophycentral.com - are either of those causing duplicate content problems on a mass scale? Google has 8k www pages indexed, and three times as many non www pages indexed.
Then looking at your inbound link profile, you've got a huge volume of inbound links from very low quality "SEO only" sites relative to your total inbound link profile. Very serious problem there.
Then you've got another site you apparently own site (StrictlyGifts.com) where you have a footer link with keywords, from every page of that site pointing to the TrophyCentral site.
The list goes on.
The cumulative impact is clearly a case of your site showing all the signs of SEO stuffing and unnatural link building. Even if some of it was unintentional (like the duplicate content conflicts across sub-domains), the pattern is clear.
1. Do all you can to get as many of the bad links removed as possible. Keep a spreadsheet of that effort.
2. Block search.trophycentral.com from search engines.
3. Either redirect mobile.trophycentral.com to the main www site and have the main www site redesigned to be flexible and responsive to different viewing platforms, or get together with a mobile SEO expert to otherwise address that duplicate content issue.
4. Add high quality unique descriptive text based content to all of your primary category and sub-category pages, and even some on every product page.
5. Consider submitting a reconsideration request to Google after you've made real headway on all of that work. Be willing to submit the spreadsheet to show links you've had removed and which you tried to but couldn't. Explain all the other steps you've taken.
You may get a bounce after that or it could just take the next Penguin update if you've done most of that before the next update.
Either way, that's just recommendations that come from only a few minutes looking at your site. There could be many other issues to address.
-
Alan, thanks. Not to sound stupid, but
1. What about the product looks like it is spam to you?
2. If I have a no index, no follow in inserts1, will that prevent goolge from all of the sub pages?
3. If the pages are already indexed, how can I get rid of them?
Sorry for the ignorant questions, but I own the business and I am not a webmaster.
Thnaks!
-
I had a quick look at this page http://www.trophycentral.com/50401.html
I found below, it is much longer thenthe sample i gave here, i would get rid of it, it looks like you are trying to spam the results
var = new Array('Have used them many times. Seamless transactions - all done through the web. Top quality product. Fast delivery. Custom engraving, including logos. Highly recommended. DR Angola, IN','This was my first order with Trophy Central, and my experience was great. I did everything on-line, the....
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Page Indexing without content
Hello. I have a problem of page indexing without content. I have website in 3 different languages and 2 of the pages are indexing just fine, but one language page (the most important one) is indexing without content. When searching using site: page comes up, but when searching unique keywords for which I should rank 100% nothing comes up. This page was indexing just fine and the problem arose couple of days ago after google update finished. Looking further, the problem is language related and every page in the given language that is newly indexed has this problem, while pages that were last crawled around one week ago are just fine. Has anyone ran into this type of problem?
Technical SEO | | AtuliSulava1 -
How to change the woocommerce product page permalink
How I can change the product URL structure. Please let me know how to fix woocommerce permalink in wordpress. My current URL is http://www.ayurjeewan.com/product/divya-ashmarihar-kwath and I want to like (only post name) http://www.ayurjeewan.com/divya-ashmarihar-kwath Attached is the screenshot of option available. qa2hZMP.jpg
Technical SEO | | JordanBrown0 -
What is the best way to stop a page being indexed?
What is the best way to stop a page being indexed? Is it to implement robots.txt at a site level with a Robots.txt file in the main directory or at a page level with the tag?
Technical SEO | | cbarron0 -
URL Structure for Product Pages
Hi Moz Community. I'm in need of some URL structure advice for product pages. We currently have ~4,000+ products and I'm trying to determine whether I need a new URL structure from the previous site owners. There are two current product URL structures that exist in our website: 1.http://www.example.com/bracelets/gold-bracelets/1-1-10-ct-diamond-tw-slip-on-bangle-14k-pink-gold-gh-i1-i2/ (old URL structure)
Technical SEO | | IceIcebaby
2. http://www.example.com/gemstone-bracelet-prd-bcy-121189/ (new URL structure) The problem is that half of our products are still in the old structure (no one moved them forward), but at the same time I'm not sure if the new structure is optimized as much as possible. Every single gemstone bracelet, or whatever product will have the same url structure, only being unique with the product number at the end. Would it be better to change everything over to more product specific URLS. I.e. example.com/topaz-gemstone-dangle-bracelet. Thanks for your help!
-Reed0 -
Staging & Development areas should be not indexable (i.e. no followed/no index in meta robots etc)
Hi I take it if theres a staging or development area on a subdomain for a site, who's content is hence usually duplicate then this should not be indexable i.e. (no-indexed & nofollowed in metarobots) ? In order to prevent dupe content probs as well as non project related people seeing work in progress or finding accidentally in search engine listings ? Also if theres no such info in meta robots is there any other way it may have been made non-indexable, or at least dupe content prob removed by canonicalising the page to the equivalent page on the live site ? In the case in question i am finding it listed in serps when i search for the staging/dev area url, so i presume this needs urgent attention ? Cheers Dan
Technical SEO | | Dan-Lawrence0 -
Struggling to get indexed and ranked
I am working on a brand new website and really struggling to get the site indexed and listed for it's business name! I don't normally struggle and have got clients ranked for much more challenging keywords so I'm a bit stuck! The site is a new domain and has been live for about two months. The business previously used an old domain and this has been correctly 301'd to the new domain. There is no duplicate content with any other website when checked through Copyscape.com Webmaster Tools has been set-up and verified and this shows the site is being crawled but in Google site:www.website.com.au shows no pages as being indexed. Google Places has been set-up and verified, the site has also been added to local citation sites. There are also a few incoming links from other sources. Robots.txt is fine and has been checked. Business name mentioned in the title tag, footer and throughout the site. Does anyone have any ideas how I might be able to get ranked or is it just a waiting game? Or have I missed out something really obvious?? My last step is doing a crawl test to see if this brings up anything I have missed. Thanks Karen
Technical SEO | | Karen_Dauncey0 -
Ranking product reviews with same keywords and similar
How you would approach keyword optimization for content that people are searching for, and has the same product name, but with the network name on the end, and it’s basically a different phone on each network – or in other cases, it’s almost an identical phone but may have very minor differences. For example, iPhone 4S- sprint vs. iPhone 4S - verizon vs. iPhone 4S at&t How you would attempt to rank for the search terms?
Technical SEO | | kcorten0 -
Properly Moving Blog from Index to its Own Page
Right now I have a website that is exclusively a blog. I want to create pages outside of the blog and move the blog to a page other than the index file e.g.) from domain.com to domain.com/blog I will have the blog post pages stay in the root directory. e.g.) domain.com/blog-post Any suggestions how to properly tell SE's and other websites that the blog has moved?
Technical SEO | | Bartell0