Google indexing my website's Search Results pages. Should I block this?
-
After running the SEOmoz crawl test, i have a spreadsheet of 11,000 urls of which 6381 urls are search results pages from our website that have been indexed.
I know I've read that /search should be blocked from the engines, but can't seem to find that information at this point. Does anyone have facts behind why they should be blocked? Or not blocked?
-
Since you already released these out to the wild, I would analyze which search results pages are bringing in traffic and use that analysis to create new category pages on your site. I would certainly block the search parameter in the Webmaster tools and in robots.txt.. Most internal search results pages have little content value and the engines now look at your site as a whole and if a certain percentage of the site is low quality, the whole site will be penalized.
-
Jenny,
Take a look at this post in the forums on indexing issues with site search - http://www.seomoz.org/q/block-search-engines-from-urls-created-by-internal-search-engine.
Allowing site search to be indexed can result in a ton of duplicate content on your site. I recommend taking the meta noindex approach.
-
well the simple answer for you is Google allocate a crawl budget based on multiple factors.
with your current setting the crawlers and wondering and going after these search page that add no value to the web. and losing alot of your budget on these search pages, where i would definitely direct these crawlers to crawl the content and update it whenever u add or update a page.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Keyword optimisation: Google's eyes before users' eyes?
Hi all, So the default and ultimate suggestion about how to rank a page high is to get favoured by users, so by the Google. But if write content in favour of users, it may miss out the keywords or will not have much keyword density and variety of keywords to get in to Google's eyes. Then we may appear around 3rd page; then how do we get into top slots? I can see some top results without even a single mention of the keyword they are ranking for. How that would be possible? Thanks
Algorithm Updates | | vtmoz0 -
Duplicate website got indexed: Caused rank drop?
Hi all, We have replica of our website with exact pages and content. That website got indexed by mistake and allowed for bots for more than 10 days. Our ranking dropped now and we moved from 2nd page to 5th page. But previously we had this happened and didn't hurt much. We got punished now? Thanks
Algorithm Updates | | vtmoz0 -
Issue with Category Ranking on Page 1 vs. Homepage Ranking on Page 2
A client has a high-volume keyword that is rendering different results, whether it is on page one or page two of Google SERPs. If the keyword is on page one, ONLY the category page is ranking. When the keyword bumps off to page two, BOTH the category AND the homepage are ranking. This is happening on our IP and theirs, incognito and personalized searches. This has been happening since February. Any thought/insights would be greatly appreciated, thank you!!!!
Algorithm Updates | | accpar0 -
Bing not indexing pages
We have taken all recommended steps to index our site sitegeek.com pages to Bing Bot but failed to index them. Bing bot crawled more than 5,000 pages every day but strange why pages are not getting index ? if we query site:sitegeek.com in Bing Bing Search Engine shows only 1,200 pages got indexed. but we query site:sitegeek.com in Google Google Search Engine show more 546,000 pages got indexed. For example : https://www.sitegeek.com/000webhost Above page crawled by Google but Bing. Can anyone suggest what we are missing on this page? what need to change to index such pages? Thanks! Rajiv
Algorithm Updates | | gamesecure0 -
Why isn't our structured markup showing in search results
Hi All, We installed Schema.org structured markup on our pages nearly 1.5 months ago at this point and we have yet to see the markup show in the search results. It also checks out in Webmaster tools and Google's structured markup language testing tool. So, I'm just confused why it's not even showing up site a "site" search in Google either. Here's an example of two such pages on our site: http://www.learningtree.com/htfu/usdc01/washington/java-perl-and-python-programming-training and http://www.learningtree.com/htfu/usat40/alpharetta/it-and-management-training Any advice is greatly appreciated! Thank you 🙂
Algorithm Updates | | CSawatzky0 -
What Is The Deal Between Indeed and Google?
Anyone notice the love affair of Indeed and Google lately? Indeed is cannibalizing the top 30 SERPs for job related keywords. Seeing keywords where Indeed has 10-15 of the organic listings in the top 30. Compete.com is showing a +8% increase in search volume between in April and May. But it seems as if they really started to cannibalize the SERPS since the Penguin update at end of May. Any one else noticing this?
Algorithm Updates | | joncrowe0 -
Shortened Title in Google Places/Local Results in SERPs
I've been doing some local SEO lately and noticed something today. When I do a search for "State/town name Cat Toys", I see the title tag of the website in the local results as opposed to the business name. I'm happy they are showing up above the normal results, but I wonder if having the brand name at the end of the site title impacts clicks. For example: Site name: New Hampshire Cat Toys and Accessories | Cats R Us But in the places results the title is cut short because they show the address, so all they see is: New Hampshire Cat Toys and.... Do you think branding is especially important in local results? Or less important? I could hear arguments for both sides. I realize the site URL is shown in green below the title, but it's not the same as having a brand in the title portion. It also looks like some of the competition has just their name show up as opposed to their website title. Is this something I can fix in Google Places, or is something Google does on its own? Cheers, Vinnie
Algorithm Updates | | vforvinnie1 -
Google personalize search results ...
Hi cant find the right term or word for it but google seems to personalize my search results according to my previous searches so that the rankings i get for a certain term isnt correct. Can i turn that off somehow ?
Algorithm Updates | | danlae0