Should I block google indexing "search.php"
-
My question is I have a search page on our website , you can search by date, number of people staying and so on, I am just wondering should block this in the robots.txt ? Because we have pretty URL'S already for searching by county and searching by towns. I cannot see any benefit of having e.g
"search/search.php?sp_dateFrom=16%2F12%2F2015&sp_dateTo=23%2F12%2F2015&sec_drop%5B%5D=727&spesh_town_id=764&q=&occupants=5&bedrooms=3&submit=SEARCH#search" indexed. Would I be correct in doing this ?
-
Second confirmation ;-), he's right. It's one of the things that for bigger sites really could get you in trouble.
-
That is the answer I was looking for, I was thinking along those lines. The problem was that Seo software was coming up with duplicate content because of different variations of the search parameters. Thanks very much for a clear and precise answer and taking time to explain this.
-
You want to block Google from any URL that produces a search result that is essentially a resorting or refiltering of a master list of search results that they have already crawled/indexed.
If you already have a set of pages that lets Google crawl all the pages in your site (could be all the products in your store, all the articles in your blog, etc), having Google crawl through variants of that same page causes a couple of problems. 1) You are wasting Google's time in spidering pages that it has already seen, vs having Google crawl your more important pages. Depending on how you have these setup, you may end up sending Google into an endless loop of non-important pages to crawl 2) You are creating pages that are generally low quality, have nothing truly original on them, they will not rank for anything anyway and may give the impression that your site consists of primarily low quality pages.
What I show Google is a single simple path to browse my content. For a blog this would be a chronological listing of articles that is paginated so that Google and the user can browse from my most recent to my oldest articles. For an ecommerce page, I might setup basic category pages, make sure the category pages have great content on them and then allow Google to crawl back through all the products based on those main category pages. If I have some products in 2 or 3 categories I do not sweat it. If on either of these examples, I show the user options to resort, filter, etc the results, I block Google with a nofollow or with robots.txt.
In your example, you already have "pretty" URLs by country and town, keep those, that will let Google and your users find your content and also provide context around that content. The crazy a$$ search URL you show is handy for your PHP code to give a search result, but would just waste Google's time. Unless you think it would be useful for a user to save the search URL results, I would see if there is a way to simply hide all the parameters from the user (submit the parameters using a POST vs a GET request for example) so that all they see in the URL result is /search/search.php
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does this index well
hi i have been looking at this template but as the content will be generated from their database will it index well - am i better to build a static equivalent using something like visual composer as i am not that technical: http://realhomes.inspirythemes.biz/listing/
On-Page Optimization | | neilhenderson0 -
90 days for Google
Hi, I'm new to Moz so still getting a feel of the forums. If my question has been answered then please point me in the right direction. I have noticed with many SEO companies they advertise that they can get you on google front page in 90 days. I'm not really interested in their techniques but more of why google takes 90+ to even appear. I have been working on my site for over a month, adding content, building good links, social media, blogs etc... but have not even come close to appearing in the top 50 pages for google. Is this normal? Is it just a matter of time before it starts to appear? Also, I have checked my backlinks and there is about 8 links that are coming from random pages in the US and some from China and india which i have no idea of. I tried to visit on of the sites but it had malware. I added all these back links to google disavow so hopefully that will fix it. Could that be the reason google would not even list my site? Thanks... Rick
On-Page Optimization | | pureozone0 -
Is it impossible to get out of Panda? Matt Cutts says if you fix the problem you "pop back" but if so why are their so few examples?
In this video matt cutts says: http://www.youtube.com/watch?v=8IzUuhTyvJk about 15 "once we re-run our data (every few weeks) if we determine your site is of higher quality you would pop back out of being affected" Panda has effected thousands of sites and a lot of smart people have been working on the problem for about 2 years since the first panda was launched, but I can only find 1 site that has "popped back" to their original rankings. e.g. http://searchengineland.com/google-panda-two-years-later-losers-still-losing-one-real-recovery-149491 Apart from Motortrend.com I can't find any sites (of reasonable size) / case studies of sites that have solved the panda problem, and were definitely hit by panda. Which doesn't feel right, some people have deleted a ton of pages, redesigned their site, improved their content, etc with no success. Therefore is it a pointless exercise? Therefore, is it better to simply give up and start a new site?
On-Page Optimization | | julianhearn1 -
How do I "leverage browser caching"
Google is telling me to "leverage browser caching" and put a freshness factor of 1 week on images used on my site. http://www.1stclassdriving.co.uk.
On-Page Optimization | | brianw10
Try as i may I cannot find out how to do this. I'm running two sites - http://www.1stclassdriving.co.uk. on a shared hosting package with Easyspace and http://www.croydondrivingschool.co.uk with Fasthosts, both under windows with asp scripting. Can anyone point me to any tutorials or guide me as to how I do this please0 -
Website Changes Updated in Google...
How long does it take for Google to recognize SEO changes that I have made to my website?
On-Page Optimization | | AubbiefromAubenRealty0 -
Quickest Way to get indexed?
We would like to index a new site on all major search engines. What is the quickest way to do so?
On-Page Optimization | | ClaytonKendall0 -
DUPLICATE PAGE VIA ONPAGE SEARCH
Hi, we have a fashion shop and we try to keep the page title as unique as possible. However google also indexes the search so the say search for brand gucci - type - dress - size 8 - then it indexes it with the homepage title rather then what the searched for. Should I block google from indexing search variation (because there could be thousand of variations) or is there a module that would use the search as a page title so gucci dress 8 for example. Many thanks for your time.
On-Page Optimization | | reallyitsme0 -
Google place 7 -> 40, why??
Hi, my new site http://www.ie-mac.com/ just dropped 33 places from place 7 to place 40 on goolge.com , for the two word combo: ie mac Did I screw up? How? Background Info: 1 Two weeks ago I moved my whole site from my old domain http://ie4mac.com/ to http://www.ie-mac.com/ with the goal of obtaining a good ranking for the keyword combo: ie mac. Apparantly tis worked- The site showed up on place 7. 2. I changed the design of the site and put the video on the front page. Good so far, still place 7, but: The text that google was showing was half the ALT-Tag of the Video first-slide image and the other half was our trademark disclaimer. 3. I changed the ALT tag and the disclaimer to give users a more inviting text on google. THis worked, google now shows the text as intended, but: For the desired combo: ie mac the site dropped to palce 40!! My best guesses at this point: 1. I'm using wordpress as a CMS and the all-in-one-seo-pack plugin to set custom titles etc., and the google XML sitemap plugin to buid an XML sitemap and notify google. During the couple of days, I made a lot of chnages to the site. Could be that the plugin pinged google a lot of times. Could this be part of the problem? 2. The site is hosted at http://www.ixwebhosting.com/ , because they give users dedicated IPs and a good price. However, the loadlevel on the server I'm on is always very high (10 - 20). I'm using a CDN for images and a caching plugin so the site loads in less than 2 seconds according to http://tools.pingdom.com/ . Unless the cache is empty, then it's 9 seconds. This is not great, but it's also no new, so: What could have caused the sudden drop from 7 to 40?? Thank you and kind regards
On-Page Optimization | | ie4mac0