Noindex pages being indexed
-
Hi all
Wondering if anyone could offer a pointer on a problem i am having please. I am developing an affiliate store and to prevent problems with duplicate content I have added name="robots" content="NOINDEX,FOLLOW" /> to all the product pages to avoid google penalties.
However, Google appears to be indexing product pages. When I do a site: search I see a few hundred product pages in the engine. This is odd as the site has always had noindex on these pages. Even viewing the cache of the indexed page shows the noindex meta tag to be in place.
I'm at a loss as to why these pages are being indexed and could do with removing them asap to stop any penalties on the site.
Many thanks for any help.
-
Thanks for taking the time to look at the site.
Not sure why the code is coming in the wrong place it is using a magento seo plugin so will need to chase them up on that. Just searched a random selection of pages and the code seems to be in the header section on all of those, so it seems there are some pages not playing nicely.
I would like to index the product pages but there are over 250,000 items pulled from the merchants and no chance of writing that much unique content so I feel safest to noindex them all. The main traffic strategy will be to use content which will promote items, such as fashion advice pieces etc.
In the example you give, that seems to be a problem with the categories, will check that out, thanks for pointing it out.
-
Okay, i have found the indexing problem. The noindex meta tag should be placed within the head section of your HTML. It is now in your body content so it's not getting used.
Are you sure you want to no-index product pages though? These are very important pages on your site and there are other ways to fix duplicate content issues.
Most duplicate content issues on pages comes from the fact that most CMS systems have the same product at different URL's. On your site i see http://yochic.co.uk/dress-267864/bodycon/black-cut-out-side-bodycon-dress.html and http://yochic.co.uk/black-cut-out-side-bodycon-dress.html
Same product, different URL. This could be fixed by adding a rel="canonical" on product pages which links back to the preferred version. Easiest would be to link back to www.domain.com/product.html
This would solve most duplicate content issues without having to deindex them.
Hope i was helpful, if you have any questions left, feel free to ask me.
-
hi, yes, maybe should have added that to start with. The site is yochic. co. uk - it is still being worked on so bear that in mind with random products in the wrong places or wonky looking menus.
The category pages are set to be indexed so no problem there, the product pages are the ones which contain the most duplicate content so have been blocked, but a number are still going in the listing.
-
Perhaps you could give us a link to your website using the following notation: domainname (dot) TLD It's difficult to tell you what the problem is without being able to take a look at your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
FAQ page structure
I have read in other discussions that having all questions on an FAQ page is the way to go and then if the question has an answer worthy of its own page, you should abbreviate the answer and link to the page with more content. My question is when using some templates in WP, they have a little + button you can click and it reveal the answer to the question. Does this hurt SEO versus having all text visible and then using headers/subheaders? An example of the + button https://fyrfyret.dk/faq/
On-Page Optimization | | OrlandSEO1 -
Duplicate Page Content
Hey Moz Community, Newbie here. On my second week of Moz and I love it but have a couple questions regarding crawl errors. I have two questions: 1. I have a few pages with duplicate content but it say 0 duplicate URL's. How do I know what is duplicated in this instance? 2. I'm not sure if anyone here is familiar with an IDX for a real estate website. But I have this setup on my site and it seems as though all the links it generates for different homes for sale show up as duplicate pages. For instance, http://www.handyrealtysa.com/idx/mls...tonio_tx_78258 is listed as having duplicate page content compared with 7 duplicate URLS: http://www.handyrealtysa.com/idx/mls...tonio_tx_78247
On-Page Optimization | | HandyRealtySA
http://www.handyrealtysa.com/idx/mls...tonio_tx_78253
http://www.handyrealtysa.com/idx/mls...tonio_tx_78245
http://www.handyrealtysa.com/idx/mls...tonio_tx_78261
http://www.handyrealtysa.com/idx/mls...tonio_tx_78258
http://www.handyrealtysa.com/idx/mls...tonio_tx_78260
http://www.handyrealtysa.com/idx/mls...tonio_tx_78260 I've attached a screenshot that shows 2 of the pages that state duplicate page content but have 0 duplicate URLs. Also you can see somewhat about the idx duplicate pages. rel="canonical" is functioning on these pages, or so it seems when I view the source code from the page. Any help is greatly appreciated. skitch.png0 -
Should I noindex, nofollow a lot of child pages?
Some category pages on my website have A LOT of product pages in them. Many of these pages do not receive any sort of organic traffic. Is there a reason for Google to be crawling these pages? Should I noindex, nofollow these pages to make Google's life a little easier? Could I possibly see some benefits from this or should I leave it the way it is?
On-Page Optimization | | jampaper0 -
When to not index
We are working on a brand new site http://www.shedfinders.com/ The site has some login sections i.e. agent profiles for property agents etc, register etc. I figured what is the harm to submit all of these in sitemap and use Yoast to ensure on page is as good as it can be. If a user stumbles across any then they would be redirected back to a a register/login page. Not sure what is best practice? Laura
On-Page Optimization | | lauratagdigital0 -
Will Google re-index the page if content is changed/improved?
Hello,
On-Page Optimization | | wickedsunny1
i have a little question, it seems most of my posts which are 3 years old or even more, all have almost same type of 2-3 lines of text at post starting and then images roundups etc.
which recently stopped getting any traffic from google. Probably becuase of lack in text etc.
So if i now edit those old pages, will they be reindexed in google with this new content/data?
thanks in advance.
cheers0 -
Why is the seomoz showing it crawled 3 pages when i only have 2 pages?
I had seomoz crawl my site. I only have 2 pages. The site url is www.autoinsurancefremontca.com.
On-Page Optimization | | Greenpeak0 -
Page titles and descriptions
A website has several wigets to show Each wiget with its own page The wigets mostly just vary in size How would you suggest titles be done? Example: Wiget 1ft Wiget 2ft Wiget 3 ft an so on........ Would this trigger a duplicate content issue given “Wiget” leads in the page title?
On-Page Optimization | | APICDA0 -
Organic Landing Pages...
For one of our sites (fastcubes.com) I noticed our landing pages were ranking and getting a few organic visits. Considering they were made specifically for PPC, I thought maybe we should create landing pages that would not be present in the navigation of the site but for the purpose of optimizing for keyword variations. For example work station cubicles vs office workstation. We have a page optimized for office workstation but having another optimized for work station cubicles is redundant. Would it be a good idea to create this as a page that is not present in the navigation for the sole person of hopefully being ranked and getting traffic for that specific keyword? Thank you in advance for your help!!
On-Page Optimization | | DevonIntl0