Google indexing my website's Search Results pages. Should I block this?
-
After running the SEOmoz crawl test, i have a spreadsheet of 11,000 urls of which 6381 urls are search results pages from our website that have been indexed.
I know I've read that /search should be blocked from the engines, but can't seem to find that information at this point. Does anyone have facts behind why they should be blocked? Or not blocked?
-
Since you already released these out to the wild, I would analyze which search results pages are bringing in traffic and use that analysis to create new category pages on your site. I would certainly block the search parameter in the Webmaster tools and in robots.txt.. Most internal search results pages have little content value and the engines now look at your site as a whole and if a certain percentage of the site is low quality, the whole site will be penalized.
-
Jenny,
Take a look at this post in the forums on indexing issues with site search - http://www.seomoz.org/q/block-search-engines-from-urls-created-by-internal-search-engine.
Allowing site search to be indexed can result in a ton of duplicate content on your site. I recommend taking the meta noindex approach.
-
well the simple answer for you is Google allocate a crawl budget based on multiple factors.
with your current setting the crawlers and wondering and going after these search page that add no value to the web. and losing alot of your budget on these search pages, where i would definitely direct these crawlers to crawl the content and update it whenever u add or update a page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google ranking penalty: Limited to specific pages or complete website?
Hi all, Let's say few pages on the website dropped in the rankings due to poor optimisation of the pages or hit by algo updates. Does Google limits the ranking drop only to these pages or the entire website will have any impact? I mean will this cause ranking drop to the homepage for primary keyword? Will Google pose the penalty to other pages in the website if few pages drop in the rankings. Thanks
Algorithm Updates | | vtmoz0 -
Indexed, though blocked by robots.txt: Need to bother?
Hi, We have intentionally blocked some of the website files which were indexed for years. Now we receive a message "Indexed, though blocked by robots.txt" in GSC. We can ignore as per my knowledge? Are any actions required about this? We thought of blocking them with meta tags but these are PDF files. Thanks
Algorithm Updates | | vtmoz1 -
Google's Importance on usability issues in sub directories or sub domains?
Hi Moz community, As the different usability issues like pagespeed or mobile responsiveness are playing a key role in website rankings; I wonder how much the same factors are important for sub directories or sub domain pages? Do each and every page of sub directory or sub domain must be optimised like website pages? Does Google gives same importance? Thanks
Algorithm Updates | | vtmoz0 -
Google's Mobile Update: What We Know So Far (Updated 3/25)
We're getting a lot of questions about the upcoming Google mobile algorithm update, and so I wanted to start a discussion that covers what we know at this point (or, at least, what we think we know). If you have information that contradicts this or expands on it, please feel free to share it in the comments. This is a developing situation. 1. What is the mobile update? On February 26th, Google announced that they would start factoring in mobile-friendliness as a ranking signal. The official announcement is here. Of note, "This change will affect mobile searches in all languages worldwide and will have a significant impact in our search results." 2. When will the update happen? In an unprecedented move, Google announced that the algorithm update will begin on April 21st. Keep in mind that the roll-out could take days or weeks. 3. Will this affect my desktop rankings? As best we know - no. Mobile-friendliness will only impact mobile rankings. This is important, because it suggests that desktop and mobile rankings, which are currently similar, will diverge. In other words, even though desktop and mobile SERPs look very different, if a site is #1 on desktop, it's currently likely to be #1 on mobile. After April 21st, this may no longer be the case. 4. Is this a boost or a demotion? This isn't clear, but practically it doesn't matter that much and the difference can be very difficult to measure. If everyone gets moved to the front of the line except you, you're still at the back of the line. Google has implied that this isn't a Capital-P Penalty in the sense we usually mean it. Most likely, the mobile update is coded as a ranking boost. 5. Is this a domain- or page-based update? At SMX West, Google's Gary Ilyes clarified that the update would operate on the page level. Any mobile-friendly page can benefit from the update, and an entire site won't be demoted simply because a few pages aren't mobile friendly. 6. Is mobile-friendly on a scale or is it all-or-none? For now, Google seems to be suggesting that a page is either mobile-friendly or not. Either you make the cut or you don't. Over time, this may evolve, but expect the April 21st launch to be all-or-none. 7. How can I tell if my site/page is mobile-friendly? Google has provided a mobile-friendly testing tool, and pages that are mobile-friendly should currently show the "Mobile-friendly" label on mobile searches (this does not appear on desktop searches). Some SEOs are saying that different tools/tests are showing different results, and it appears that the mobile-friendly designation has a number of moving parts. 8. How often will mobile data refresh? Gary also suggested (and my apologies for potentially confusing people on Twitter) that this data will be updated in real-time. Hopefully, that means we won't have to worry about Penguin-style updates that take months to happen. If a page or site becomes mobile-friendly, it should benefit fairly quickly. We're actively working to re-engineer the MozCast Project for mobile rankings and have begun collecting data. We will publish that data as soon as possible after April 21st (assuming it;s useful and that Google sticks to this date). We're also tracking the presence of the "Mobile-friendly" tag. Currently (as of 3/25), across 10,000 page-1 mobile results, about 63% of URLs are labeled as "Mobile-friendly". This is a surprisingly large number (to me, at least) - we'll see how it changes over time.
Algorithm Updates | | Dr-Pete15 -
My Website is not stable
My website is daily showing different position on google.com on all its keywords like one day first page on all keywords next day 3rd page on all keywords for the last one month. Is this a Google Dance ?? what can be its period ? and what is the solution to handle it ??
Algorithm Updates | | mnkpso0 -
Website dance on Google Map results and organic seo results
My website is daily showing different position on maps.google.com and for the last few days like yesterday it was on 21st position on some keyword and today it is no where and same with other keywords. Is this a Google Dance ?? what can be its period ? and what is tyhe solution to handle it ??
Algorithm Updates | | mnkpso0 -
How long does it take for a new website to start showing in the SERP'S
I launched my website about 6 weeks ago. It was indexed fairly quickly. But it is not showing up in the Google SERP. I did do the on page SEO and followed the best practise's for my website. I have also been checking webmaster tools and it tells me that there is no errors with my site. I also ran it through the seomoz on page seo analyzer and again no real big issues. According to seomoz I had 1 duplicate content issue with my blog posts, which i corrected. I understand it takes some time, but any ideas of how much time? And f.y.i it's a Canadian website. So it should be a lot easier to rank as well. Could my site be caught in the Google 'sandbox effect' ? Any thoughts on this would be greatly appreciated.
Algorithm Updates | | CurtCarroll0 -
Lesser visited, but highly ranked landing paged dropped in rank on Google. Time for a content update?
I noticed that my page one ranked landing pages that don't get a lot of love from me have dropped in rank big time on Google this week. This is a site that has static (meaning, I can't freshen up the content easily) landing pages for products that we sell. The pages that dropped are the ones that have the fewest inbound links, and don't get much attention on the social media side. Our most important landing pages have also dropped, but just a few spots on page one. This is a first for me. Does anyone think that this is a "lack of freshness" penalty? We are still number one on page one for our brand search terms. Would fresh content give me a shot at getting the pages back up? I'm willing to update them slowly, but before I go crazy, I'm reaching out to the pros here.
Algorithm Updates | | Ticket_King0