How to properly remove pages and a category from Google's index
-
I want to remove this category http://www.webdesign.org/web-design-news-all/ and all the pages in that category (e.g. http://www.webdesign.org/web-design-news-all/7386.html ) from Google's index.
I used the following string in the "Reomval URS" section in Google Webmaster Tools:
http://www.webdesign.org/web-design-news-all/*
is that correct or I better use http://www.webdesign.org/web-design-news-all/ ?
Thanks in advance.
-
Thanks for your replies guys. Now I know how to proceed.
-
In addition I would put the "No Index" meta attribute in the pages.
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=93710
-
It sounds like you want to de-index them.
Go into your robots.txt and disallow Google from the category..
It will look something like this:
User-agent: googlebot or *
Disallow: /web-design-news-all/
-
Are you removing the pages or just trying to de-index them? If you're trying to remove them, make sure the old pages return a 404 so they can't be restored to the index. If you're trying to remove them, make sure they are excluded by robots.txt or meta tag.
Here's the WMT Help page on the topic
http://support.google.com/webmasters/bin/answer.py?hl=en&answer=1663427
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
URL Structure on Category Pages
Hi, Currently, we having the following URL Structure o our product pages: All Products Pages: www.viatrading.com/wholesale/283/All_Products.html Category Page: www.viatrading.com/wholesale/4/Clothing.html Product Page: www.viatrading.com/wholesale/product/LOAD-HE-WOM/Assorted-High-End-Women-Clothing-Lots.html?cid=4 Since we are going to use another frontend system, we are thinking about re-working on this URL Structure, using something like this: All Products Pages: www.viatrading.com/wholesale-products/ Category Page: www.viatrading.com/wholesale-products/category/ Product Page: www.viatrading.com/wholesale-products/category/product-title/ I understand this is better for SEO and user experience. However, we already have good traffic on the current URL Structure. Should we use same left-side filters on Category Pages as in All Products Page? Since we are using Faceted Navigation, when users filter the Category (e.g. Clothing) they will see same page as Clothing Category Page. Is that an issue for Duplicate Content? Since we are a wholesale company - I understand is using "/wholesale/products/" in URL for all product pages a good idea? If so, should we avoid word "wholesale" in product-title to avoid repeated word in URL? For us, SKU in URL helps the company employees and maybe some clients identify the link. However, what do you think of using the SEO-friendly product-title, and 301 redirect it to www.viatrading.com/BRTA-LN-DISHRACKS/, so 1st link is only used by company members and Canonicalized 2nd is the only one seen by general public? Thank you,
On-Page Optimization | | viatrading10 -
Should Title Tags Differ From H1's?
I never thought this was an issue, but now, I'm not so sure. Is it a problem for your title tags to be identical to your H1's? From Moz' OnPage Grader section on "H1's and Title Tags," I thought they were supposed to both match your keyword. Any thoughts? Thanks, Ruben
On-Page Optimization | | KempRugeLawGroup0 -
Google Doesn't Display A Right Page Title
For some reason Google Displays a wrong page title of some of my pages. E.g. page http://www.imoney.my/home-loan The title in the search reach results says "Home Loan - iMoney", but the one I've set up is <title></span><span class="webkit-html-tag">Housing Loan: Compare Mortgages of All Malaysian Banks @iMoney.my</span><span class="webkit-html-tag"></title> Even when I preview it on the preview tool, it shows the full title, but when I google - again the short one. Does anyone know what the reason for that is?
On-Page Optimization | | imoney0 -
Search Pages outranking Product Pages
A lot of the results seen in the search engines for our site are pages from our search results on our site, i.e. Widgets | Search Results This has happened over time and wasn't intentional, but in many cases we see our search results pages appearing over our actual product pages in search, which isn't ideal. Simply blocking indexing of these pages via robots wouldn't be ideal, at least all at once as we would have that period of time where those Search Results pages would be offline and our product pages would still be at the back of ranking. Any ideas on a strategy to replace these Search Results with the actual products in a way that won't hurt us too bad during the transition? Or a way to make the actual product pages rank above the search results? Currently, it is often the opposite. Thanks! Craig
On-Page Optimization | | TheCraig0 -
How google handle with Title when is invisible on the page?
I would like to display H1 Title tag invisible on the homepage. I set up Title colour same colour as background colour. How google handle with this cloaking? What should I to set up in the style.css?
On-Page Optimization | | joeko0 -
Google Indexing
Hi, We recently launched a new version of our site on the Magento platform. I submitted a new sitemap and on the first crawl only 7 pages out of 132 were indexed...a few days later and we now have 107 indexed (phew). My question is this....how on earth do i find out which pages are indexed and more importantly not indexed? For all i know they might be really important ones so I need to be able to identify the missing pages so i can work on getting them indexed. Nic
On-Page Optimization | | nicc19760 -
Duplicate Page Content for Product Pages
Hello, We have one website which URL is http://www.bannerbuzz.com & we have many product pages which having duplicate page content issue in SEOMOZ which are below. http://www.bannerbuzz.com/backlit-banners-1.html
On-Page Optimization | | CommercePundit
http://www.bannerbuzz.com/backlit-banners-10.html
http://www.bannerbuzz.com/backlit-banners-11.html
http://www.bannerbuzz.com/backlit-banners-12.html
http://www.bannerbuzz.com/backlit-banners-13.html We haven't any content on these pages, still getting duplicate page content errors for all pages in SEOMOZ. Please help me how can i fix this issue. Thanks,0 -
Post Title - Use the blog's name or not?
In the tile of my post, shoudl I used my blog's name in it at the end or emit the blog name. EX: title of post with keywords | name of blog OR EX: title of post with keywords The site's name is 3 words long, so I'm worrying that those extra words are diluting the keywords in the post's name that I'm trying to target.
On-Page Optimization | | gregalam0