Should I block google indexing "search.php"
-
My question is I have a search page on our website , you can search by date, number of people staying and so on, I am just wondering should block this in the robots.txt ? Because we have pretty URL'S already for searching by county and searching by towns. I cannot see any benefit of having e.g
"search/search.php?sp_dateFrom=16%2F12%2F2015&sp_dateTo=23%2F12%2F2015&sec_drop%5B%5D=727&spesh_town_id=764&q=&occupants=5&bedrooms=3&submit=SEARCH#search" indexed. Would I be correct in doing this ?
-
Second confirmation ;-), he's right. It's one of the things that for bigger sites really could get you in trouble.
-
That is the answer I was looking for, I was thinking along those lines. The problem was that Seo software was coming up with duplicate content because of different variations of the search parameters. Thanks very much for a clear and precise answer and taking time to explain this.
-
You want to block Google from any URL that produces a search result that is essentially a resorting or refiltering of a master list of search results that they have already crawled/indexed.
If you already have a set of pages that lets Google crawl all the pages in your site (could be all the products in your store, all the articles in your blog, etc), having Google crawl through variants of that same page causes a couple of problems. 1) You are wasting Google's time in spidering pages that it has already seen, vs having Google crawl your more important pages. Depending on how you have these setup, you may end up sending Google into an endless loop of non-important pages to crawl 2) You are creating pages that are generally low quality, have nothing truly original on them, they will not rank for anything anyway and may give the impression that your site consists of primarily low quality pages.
What I show Google is a single simple path to browse my content. For a blog this would be a chronological listing of articles that is paginated so that Google and the user can browse from my most recent to my oldest articles. For an ecommerce page, I might setup basic category pages, make sure the category pages have great content on them and then allow Google to crawl back through all the products based on those main category pages. If I have some products in 2 or 3 categories I do not sweat it. If on either of these examples, I show the user options to resort, filter, etc the results, I block Google with a nofollow or with robots.txt.
In your example, you already have "pretty" URLs by country and town, keep those, that will let Google and your users find your content and also provide context around that content. The crazy a$$ search URL you show is handy for your PHP code to give a search result, but would just waste Google's time. Unless you think it would be useful for a user to save the search URL results, I would see if there is a way to simply hide all the parameters from the user (submit the parameters using a POST vs a GET request for example) so that all they see in the URL result is /search/search.php
Good luck!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I analysis my domain (http://yourdigibuddy.com/) on moz domain analysis. But there is not data show and show message "No data here". What should I do?
_ I analysis my domain (http://yourdigibuddy.com/) on Moz domain analysis. But there is not data show and show the message "No data here". What should I do?_
On-Page Optimization | | MelissaDooley0 -
My exactly website name is not in google search
my web site tournet.co but when i search that in google , google can not find it in search result . i have to say my website is a new site and its age is 3 month .
On-Page Optimization | | p.farrhad12365410 -
Indexing Issues
One of the main pages on my site, http://www.waikoloavacationrentals.com/kolea-rentals/condos, I have been having a hard time getting google to index it correctly or at all. It is one of the top pages on my site and should be in my sub links in google, but it is not even showing up in searches. Any input would be appreciated. The only red flap issue is the number of outgoing links, but that is the way the page is supposed to be. I would assume most real estate listing pages are very similar. Ultimately when you look at traffic, time on page, inbound links, etc. it is one of the top pages on my site in all those categories. Any input would be greatly appreciated.
On-Page Optimization | | RobDalton0 -
Google Console returning zero data
Hi. I verified my site both www. and non www. with google search console a while back and yet for neither domain am I seeing any data at all under Search Appearance and under index status (under google index) it is saying 0 pages indexed even though I can see in google search there are over 116. Any idea why this might be? Thanks
On-Page Optimization | | CosiCrawley0 -
Google index new data from my website page
Hi All, We have pages which are created few weeks before hand for Movie reviews in those pages we add value with adding the Movie cast and crew info and what ever info possible before the movie releases. The the movie releases we watch the movies and write reviews which is 500+ words. Now the issue is the pages are indexed a week before... How can i have these review pages scanned immediately when i have the complete review as the review content is not indexed for 3 to 5 days and the first day or 2 is when its important for the reviews to be seen in Google. Regards
On-Page Optimization | | AlexisWithers0 -
Google index text that I can not find
Hello everybody, As you can see here: http://webcache.googleusercontent.com/search?q=cache:G-iicHoDJeYJ:www.billigste-internet.dk/&hl=da&gl=dk&strip=1 Google index the text "Forside" as the H1 tag, and "Right" and "Left" as body text, on my website. But I do not want that Google indexes this. But when I look in mine source code (see here: view-source:http://www.billigste-internet.dk/) I can not find "Forside", "rigth" or "Left", so I can delete it. Is there anyone who can help me where I need to delete the text "Forside", "Right" and "Left", so Google does not index this text? Hope someone can help.
On-Page Optimization | | JoLindahl910 -
A "show all" category for products resulting in to many on-page links
I've got reports from my seomoz pro campaign that I have more than 100 on-page links on a page of my ecommerce store. This page is a "show all" category displaying ALL products from ALL my categories on the site. So it is NOT a "show all" for displaying all products in a certain category on one page instead of having to click through page 1, page 2 etc. What I don't clearly understand is why I get this from the reports, as it does not display all products in one single page. What it does is gathering all products from all categories in one place, but instead of showing all products in one page it is divided into pages 1 - 13. What should I do to resolve this? Could it be the seomoz campaign giving me an incorrect result? Appreciate you taking the time to help! Thank you.
On-Page Optimization | | danielpett0 -
No Index help
Hi, I have alot of notices about webpages that are apparently blocked by no index robots, I look through the code on the site and cannot see any coding for this and am confused how to fix the problem. Help anyone?
On-Page Optimization | | Vetshopgroup0