How do I deindex url parameters
-
Google indexed a bunch of our URL parameters. I'm worried about duplicate content. I used the URL parameter tool in webmaster to set it so future parameters don't get indexed. What can I do to remove the ones that have already been indexed? For example, Site.com/products and site.com/products?campaign=email have both been indexed as separate pages even though they are the same page. If I use a no index I'm worried about de indexing the product page. What can I do to just deindexed the URL parameter version?
Thank you!
-
Thanks everyone this is really helpful!
-
As Linda mentioned, adding a canonical url to the version without parameter is the best solution as it gives you control on which pages should be in the index.
For the sake of completeness - in webmaster tools you also have the option to tell the Google bot how it should deal with parameters (under Crawl > URL parameters). Note however that Google itself doesn't really recommend using this option.
rgds
Dirk
-
Hey there!
I would also add that you can look at the Robots.txt Specifications resource from Google for tips.
Hope this helps as well!
-
Put a canonical tag on site.com/products to itself and the parameter versions will go away. (They eventually will anyway--duplicate content does not cause a penalty, it just causes duplicate versions to not be indexed, which is what you want anyway.)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Cache showing a different URL
Hi all, very weird things happening to us. For the 3 URLs below, Google cache is rendering content from a different URL (sister site) even though there are no redirects between the 2 & live page shows the 'right content' - see: http://webcache.googleusercontent.com/search?q=cache:http://giltedgeafrica.com/tours/ http://webcache.googleusercontent.com/search?q=cache:http://giltedgeafrica.com/about/ http://webcache.googleusercontent.com/search?q=cache:http://giltedgeafrica.com/about/team/ We also have the exact same issue with another domain we owned (but not anymore), only difference is that we 301 redirected those URLs before it changed ownership: http://webcache.googleusercontent.com/search?q=cache:http://www.preferredsafaris.com/Kenya/2 http://webcache.googleusercontent.com/search?q=cache:http://www.preferredsafaris.com/accommodation/Namibia/5 I have gone ahead into the URL removal Tool and got denied for the first case above ("") and it is still pending for the second lists. We are worried that this might be a sign of duplicate content & could be penalising us. Thanks! ps: I went through most questions & the closest one I found was this one (http://moz.com/community/q/page-disappeared-from-google-index-google-cache-shows-page-is-being-redirected) but it didn't provide a clear answer on my question above
Technical SEO | | SouthernAfricaTravel0 -
Making URLs automatically clickable
Hi all, I have a PHP function which i use to make all links clickable. Problem is, if some one writes a link in a a-tag, the URL inside the href value is made clickable. Not good. Can someone perhaps help me with the issue? Function: function makeClickableLinks($text)
Technical SEO | | rasmusbang
{
$text = preg_replace('/<//', ' $text = preg_replace('(
)', '
', $text);
$text = preg_replace('!((https?://www.|https?://|www.)(([a-z0-9-]+.)+[a-z]{2,6})(/\S+|/)*)!ie', '"[".shortenurl("\1")."]("".(strtolower('$2'))"', $text);
$text = str_replace('( <a href',="" '<a="" $text);<br="">$text = str_replace(')" target', '" target', $text);
$text = str_replace('):" target', '" target', $text);
$text = str_replace(')..." target', '" target', $text);
$text = str_replace(').." target', '" target', $text);
$text = str_replace(')." target', '" target', $text);
return $text;
}</a> <a href',="" '<a="" $text);<br="">Pleeeeease heeelp 🙂 Can't fix it on my own - been at it for ages. -Rasmus</a>0 -
When to use canonical urls
I will be the first to admit I am never really 100% sure when to use canonical urls. I have a quick question and I am not really sure if this is a situation for a canonical or not. I am looking at a my friends building website and there are issues with what pages are ranking. Basically there homepage is focusing on the building refurbishment location but for some reason in internal page is ranking for that keyword and it is not mentioned at all on that page. Would this be a time to add the homepage url and a canonical on the ranking page (using yoast plugin) to tell Google that the homepage is the preferred page? Thanks Paul
Technical SEO | | propertyhunter0 -
Blank Canonical URL
So my devs have the canonical URL loaded up on pages automatically, and in most cases this gets done correctly. However we ran across a bug that left some of these blank like so: Does anyone know what effect that would have? I am trying to provide a priority for this so I can say "FIX IT NOW" or "Fix it after the other 'FIX IT NOW' type of items". Let me know if you have any ideas. I just want to be sure I am not telling google that all of these pages are like the home page. Thanks!
Technical SEO | | SL_SEM0 -
Suggested url structure for hierarchical data
For an existing web site we are developing a local info web site section where each area would get a review and information about local bars and restaurants. The site manages areas in the following hierarchy: Country > Broader region > Perfecture > Municipality > Neighborhood e.g. Italy > Northern Italy > Lombardia > Milano > Center Local Info pages would exist for all the above levels so you could have a page for Italy as a whole, a page for Lombardia, and a separate page for the Center of Milano. On certain countries there are many synonyms especially in the Neighborhood level but also a few in the Municipality level. We would like to build a generic SEF url structure/pattern that would be able to represent the above and be as short as possible for the purpose of SEO. 1. the obvious solution would be to incorporate the unique identifier of e.g. www.example.com/local-info/Italy-10
Technical SEO | | seo-cat
www.example.com/local-info/Milano-12363
www.example.com/local-info/Center-789172 but this does not represent the hierarchy and does not include the interesting keyword of e.g. Milano when looking at the neighborhood level 2. Another option would be to include all levels e.g. www.example.com/local-info/Italy/Northern-Italy/Lombardia
www.example.com/local-info/Italy/Northern-Italy/Lombardia/Milano
www.example.com/local-info/Italy/Northern-Italy/Lombardia/Milano/Center But this would end up with large URLs 3. I am thinking of another solution which would include the current level and its parent at any page. Not capturing the hierarchy very well but at least it includes the parent name for richer keywords in the url itself. www.example.com/local-info/Northern-Italy/Lombardia
www.example.com/local-info/Lombardia/Milano
www.example.com/local-info/Milano/Center 4. Or a hybrid where the first levels are always there and the rest are concatenated on a single segment www.example.com/local-info/Italy/Northern-Italy/Lombardia
www.example.com/local-info/Italy/Northern-Italy/Lombardia-Milano
www.example.com/local-info/Italy/Northern-Italy/Lombardia-Milano-Center any thoughts? thanks in advance0 -
Breadcrumb navigation with URL ending
Will it make a difference if a page has this format for URLs and breadcrumb navigation www.domain.com/category.html
Technical SEO | | Motava
www.domain.com/category/product1.html vs. www.domain.com/category/
www.domain.com/category/product1.html
or
www.domain.com/category/product1 does it make sense to change the category page or will it not make a huge difference?0 -
Rel=Canonical to Rewrite or original URL?
Working with a large number of duplicate pages due to different views of products. Rewriting URLs for the most linked page. Should rel=canonical point to the rewritten URL or the actual URL? Is there a way to see what the rewritten URL is within the crawl data? I was taking the approach of rewriting only the base version of each page and then using a rel=canonical on the duplicate pages. Can anyone recommend a better or cleaner approach? Haven't seen too many articles on retail SEO when faced with a less than optimized CMS. Thanks!
Technical SEO | | AmsiveDigital0 -
Page Titles where URL customization is limited
Hi all, I'm working for a new company which has several websites built on the Miva Merchant 5.5 platform. I'm new to SEO and trying to improve one specific category of products. With Miva the URL structure is set to: "category/" or "product/". I would have liked to have the ability to create URLs like "bike/beach-cruisers/mens-red-hawaiian.html". Since I cannot do that I'm trying to determine the best product name and page titles. Currently all of our titles have the word "bike". So when a category page is displayed, which shows over 100 products I get flagged in my campaign for over using the keyword "bike". However, if I take the work "bike" out of the page title I'm concerned that it would hurt us in the SERPs. Another factor that I'm getting flagged for on my campaign is the fact that our navigation uses the same key words repeatedly in each link. I'm not sure if it's really hurting us or not. Below is an example. I'm looking for some input on recommendations for product names and page titles. Below are some examples of what I'm working with. Any input or suggestions are greatly appreciated. Menu Sample: Bikes-Street-Blue-Mens Bikes-Street-Blue-Womens Bikes-Street-Blue-Kids Bikes-Street-Orange-Mens Bikes-Street-Orange-Womens Bikes-Street-Orange-Kids Bikes-Beach-Cruiser-Blue-Mens Bikes-Beach-Cruiser-Blue-Womens Bikes-Beach-Cruiser-Blue-Kids Bikes-Beach-Cruiser-Orange-Mens Bikes-Beach-Cruiser-Orange-Womens Bikes-Beach-Cruiser-Orange-Kids Current Page Titles/Name: Mens Bike Street Blue | XYZ Bike Mfg. - product/mens-bike-street-blue.html Mens Bike Street Orange | XYZ Bike Mfg. - product/mens-bike-street-orange.html Womens Bike Street Blue | XYZ Bike Mfg. - product/womens-bike-street-blue.html Womens Bike Street Orange | XYZ Bike Mfg. - product/womens-bike-street-orange.html
Technical SEO | | Technical_Contact0