Should I block google indexing "search.php"
-
My question is I have a search page on our website , you can search by date, number of people staying and so on, I am just wondering should block this in the robots.txt ? Because we have pretty URL'S already for searching by county and searching by towns. I cannot see any benefit of having e.g
"search/search.php?sp_dateFrom=16%2F12%2F2015&sp_dateTo=23%2F12%2F2015&sec_drop%5B%5D=727&spesh_town_id=764&q=&occupants=5&bedrooms=3&submit=SEARCH#search" indexed. Would I be correct in doing this ?
-
Second confirmation ;-), he's right. It's one of the things that for bigger sites really could get you in trouble.
-
That is the answer I was looking for, I was thinking along those lines. The problem was that Seo software was coming up with duplicate content because of different variations of the search parameters. Thanks very much for a clear and precise answer and taking time to explain this.
-
You want to block Google from any URL that produces a search result that is essentially a resorting or refiltering of a master list of search results that they have already crawled/indexed.
If you already have a set of pages that lets Google crawl all the pages in your site (could be all the products in your store, all the articles in your blog, etc), having Google crawl through variants of that same page causes a couple of problems. 1) You are wasting Google's time in spidering pages that it has already seen, vs having Google crawl your more important pages. Depending on how you have these setup, you may end up sending Google into an endless loop of non-important pages to crawl 2) You are creating pages that are generally low quality, have nothing truly original on them, they will not rank for anything anyway and may give the impression that your site consists of primarily low quality pages.
What I show Google is a single simple path to browse my content. For a blog this would be a chronological listing of articles that is paginated so that Google and the user can browse from my most recent to my oldest articles. For an ecommerce page, I might setup basic category pages, make sure the category pages have great content on them and then allow Google to crawl back through all the products based on those main category pages. If I have some products in 2 or 3 categories I do not sweat it. If on either of these examples, I show the user options to resort, filter, etc the results, I block Google with a nofollow or with robots.txt.
In your example, you already have "pretty" URLs by country and town, keep those, that will let Google and your users find your content and also provide context around that content. The crazy a$$ search URL you show is handy for your PHP code to give a search result, but would just waste Google's time. Unless you think it would be useful for a user to save the search URL results, I would see if there is a way to simply hide all the parameters from the user (submit the parameters using a POST vs a GET request for example) so that all they see in the URL result is /search/search.php
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Dissapeared from Google - Urgent
We are new to the whole SEO thing and could be described as total numpties as we have hidden away from it, scared of what it means and what might happen if we open that can of worms. But after seeing a 25% drop in visitors over a year, and a continued fall, we thought we better try and get our heads around what we need to do to improve our chances on google. Consequently we have signed up to MOZ and are exploring its crawl results and trying to learn and action things. Today we noticed that we have dropped fairly completely from Google for many of our top key words. We are based in Italy,our site is in Italian and we only target Italy. Our homepage is http://www.shoechic,it and two of our top keywords that have dissapeared are: "scarpe sexy" & "Scarpe Pleaser" We would love to hear if anyone can throw some light in why this dramatic change may have taken place and what we can do to address it. Many thanks in advance for anyones help and advice. Philip
On-Page Optimization | | shoechic0 -
Google Rich Snippet
So i have been implementing rich snippets for work and all has been good until now, As you can see below the meta description has all of a sudden included the review date. The review date is the only date on the page. Any ideas what could be causing this? Thanks wqLKKl9
On-Page Optimization | | David-McGawn0 -
How to rank in Google during domain name search?
We have received one requirement for this website. http://www.coldcasebeer.com/ We would like to rank in Google during domain name search. If we are going to search following search terms in Google then We are not able to see this domain on first page of Google search result. cold case beer coldcasebeer We have done quick research on this issue. And, We have decided to implement following tasks to make it happen.But, We are quite excited to read certain inputs on this question from experts! 1. Upload default Robots.txt file 2. Verify website on Google webmaster tools 3. Set up USA region on Google webmaster tools 4. Submit Google crawl request on Google webmaster tools 5. Title tag and Meta description optimization for all pages (There are 5 pages only on website) 6. Audit Google local listing 7. Develop quality links with domain name
On-Page Optimization | | CommercePundit0 -
How can i block the below URLs
Google indexed plugins pages for my website. Please check below. How can stop them to be indexed on google.? http://www.ayurjeewan.com/wp-content/plugins/LayerSlider/static/skins/glass/ http://www.ayurjeewan.com/wp-content/plugins/LayerSlider/static/skins/borderlesslight3d/ http://www.ayurjeewan.com/wp-content/plugins/LayerSlider/static/skins/defaultskin/ My robots.txt file is - User-agent: * Disallow: /wp-admin/
On-Page Optimization | | MasonBaker0 -
USA appears in search snippet
Buongiorno from 14 degrees C very cloudy Wetherby UK, When I type "Dartex Coatings" in Google i get a search snippet with USA in the description. See illustration: http://i216.photobucket.com/albums/cc53/zymurgy_bucket/usa-indescription-2_zps42296e0a.jpg I cannot see where this is comming from on site http://www.dartexcoatings.com/ . HAving checked the souce code there is no reference to USA 😞 So my question is please..."where is Google picking up USA from"? Grazie,
On-Page Optimization | | Nightwing
David0 -
Google Custom Search
Hello, Is there anyone use goolge custom search? and will it improve my website ranking?
On-Page Optimization | | JohnHuynh0 -
Indexation problem
Hello, I have an online store specialized in offers and discounts (http://www.offertazo.com/) with an indexation problem. The products are not updated correctly. I think the problem is that when I publish a new offer, it doesn´t appear on the top of my page´s SERP. I would appreciate any suggestions. Best regwards.
On-Page Optimization | | ofuente0 -
Search engine friendly URLs
I'm going to create some new content for my site, I'm trying to decide on the best search engine friendly format. Namely, is it ok to use a subdirectory or should I keep all content on root level? Is the SEO effect of either of these URLs superior to the other? domain.com/cooking/lasagna.php vs domain.com/lasagna.php
On-Page Optimization | | limens0