Should Blog Category Archive URLs be Set to "No-Index" in Wordpress?
-
It appears that Google Webmaster Tools is listing about 120 blog archives URLs in Google Index>Index Status that should not be listed. Our site map contains 650 pages, but Google shows 860.
Pages like:
<colgroup><col width="464"></colgroup>
| http://www.nyc-officespace-leader.com/blog/category/manhattan-office-space |With Titles Like:
<colgroup><col width="454"></colgroup>
| Manhattan Office Space Archives - Metro Manhattan Office Space |Are listed when in the Rogerbot crawl report for the site.
How can we remove such pages from Google Webmaster Tools, Index Status? Our site map shows about 650 pages, yet Google show these extra pages. We would prefer that they not be indexed.
Note that these pages do not appear when we run a site:www.nyc-officespace-leader.com search.
The site has suffered a drop in ranking since May and we feel it prudent to keep Google from indexing useless URLs. Before May 650 pages showed on the Webmaster Tools Index status, and suddenly in early June when we upgraded the site the index grew by about 175 pages. I suspect the 120 blog archives URLs may have something to do with it. How can we get them removed?
Can we set them to "No-Index", or should the robot text be used to remove them? Or can some type of removal request be made to Google?
My developers have been struggling with this issue since early June. The bloat on the site is about 175 URLs not on the site map. Is there any go to authority on this issue (it is apparently rather complicated) that can provide a definitive answer?
Thanks!!
Alan -
Yup!
-
Hi Daniel:
You are correct other factors are probably contributing to the drop. The 175 extra URLs are a contributing factor. Our site contains 310 property listing pages of which 250 have a few sentences. It appears we were penalized by Panda 4.0 in May, which apparently targets thin content.
To reverse the penalty we intend to take the following steps:
-Set all listing pages with thin content pages to "No-Index, Follow"
-Somehow remove the 175 URLs that have magically appeared in June. Either set as "no-index, follow", "no-index, no-follow" canonicalize or somehow delete use robot text. My concern is that these 175 extra URLs could be construed as thin content and could be aggravating the Panda penalty.
-Enhance content on 30-40 critical pages.Does this seem reasonable?
Thanks, Alan
-
You wrote:
The site has suffered a drop in ranking since May and we feel it prudent to keep Google from indexing useless URLs. Before May 650 pages showed on the Webmaster Tools Index status, and suddenly in early June when we upgraded the site the index grew by about 175 pages. I suspect the 120 blog archives URLs may have something to do with it. How can we get them removed?
But is it possible this is an unwarranted conclusion? Perhaps you are heading down the wrong path in attempting removal.
Have you exhausted all other possibilities?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Migrate from HTML to Wordpress?
My website is currently HTML because in the past, I liked a more hands-on approach and liked to have a high level of control over my code. My organic search rankings are very good. I do have a blog on wordpress now. Despite all of this, I am considering moving to Word Press. The reason is that the fancier website techniques are very easy to achieve with a wordpress theme or plug-in. And some changes, such as menu, can be done at the high level versus the entire site. Auto-responsive is built within the themes, so anytime a new device comes out, they update it so I don't have to. And, I would like to be more tightly integrated with my blog. I am also getting to the points that I have no time to code and would like something a little simpler to maintain. BUT, I am scared to make the move and then completely lose my organic rankings. I know that I will have to 301 all of the pages. And I know that I will have to maintain all my current on-page SEO by paying close attention to the headers and whatnot. Do you all think that it is worth making the switch? Is there a good chance my organic rankings will drop?
Web Design | | CalicoKitty20000 -
Heres a puzzle for you... Htags on left hand nav for ecomm category pages
Hi Guys, So I am back asking more questions, but I am slowly learning 🙂 This next one, I have looked everywhere and I can't get my head around h tags on ecomm sites. I have looked at competitors and non competitors and still am not sure which is the right or wrong thing to do, specifically in this instance, category pages. Our I.T. dept is somewhat under resourced and I don't want to waste their time with test and trial on this particular issue. Category landing pages... There are shed loads of category listing pages on our site, at the moment the h1 tag for each sub-category is listed in the end path of the breadcrumb, there is no other spaces on the page accept the left hand navigation. Which is the better to use, breadcrumb or nav? We would have to totally recode our left hand nav which is pretty set up for the whole site. The reason I ask this question to you is because an SEO agency recommended that we... Add the H1 to the left hand navigation and make it customisable so that it is not the same as the breadcrumb keywords. I have attached an image of a competitor of ours that so the same thing currently, to show what I mean... Right now I am not sure what to tell the agency and what the right thing to do is. I read a post saying that we are actually doing the right thing under the circumstances. Does anyone have a best practise good example of generally what we should do for category pages? Your help is always muchly appreciated Kindest, Kay new
Web Design | | eLab_London0 -
Wordpress Custom Permalinks Plugin Issue
Hello, I installed this plugin and I'm having trouble making it work. I'm new to WordPress so was hoping someone can help me out. I'm looking to set up the following pages for example
Web Design | | ec1976
http://testsite.azurewebsites.net/Services/Services1
http://testsite.azurewebsites.net/Services/Services2 I do the following steps Add New Page Enter the following title "Services1" Enter the following text in the Permalink textbox "Services/Services1" replacing the default text "?page_id=140" Then I publish the page. This automatically updates the "Custom Fields" section below. The name is set to "custom_permalink" and the value is set to "Services/Services1". Then I "view page" but get a 404 error. The url is "http://testsite.azurewebsites.net/Services/Services1" Some additional info 1. WordPress version 9.8.3 Settings - Permalinks is set to "post name" Custom Permalinks version 0.7.18 Any help would be greatly appreciated. Thanks0 -
How to do a non-spammy "doorway page"?
Hi there, ISSUE: I have a client who wishes to use a "doorway" page, but not in a spammy way. He would like to have a nice crisp URL for use in ads/brochures. The page is strictly a landing page (just with a separate URL). DOORWAY/LANDING PAGE WILL BE: Non-spammy -- There will be no attempt to optimize the landing page/no attempt to get the page to rank. Strictly a vanity URL -- he likes the way a separate website looks in ads as opposed to a landing page on the existing website (i.e., www.websitename.com/landing page) WHAT I'M TRYING TO DO: I'm basically trying to figure out what the best things to do to protect his other sites (which are very high quality valuable sites which rank well) from getting punished. STEPS I'M CONSIDERING: Robots no follow Separate hosting server Different person's name on a private domain registration Adding additional pages, so it's not a 1-page "doorway" Many thanks in advance to anyone who would share their experience and help me protect my client in the best way possible. I've told him there are risks, but he still wants to go ahead. MC
Web Design | | marketingcupcake1 -
How keywords per page to keep from being "spammy"?
Hi all, I am currently doing a marketing internship for a B2B company that does all sorts of out-sourced recruiting work. I have some experience with SEO, but not completely confident. My first question is, I know Google sees websites that load up on keywords as "spammy", so what is the appropriate number of keywords per page? Currently, I was thinking about this setup: 1 keyword for the URL 1 keyword per alt tag (1 per page, at most) 2 keywords per each title tag (approximately 4 pages that I am going to follow internally, not following the "about us" page). After that, I was thinking of adding 2-3 more keywords in each meta description and 2-3 in the body copy. That would equate to 6-8 keywords on each page, is this too many and should keywords be repeated (on the same page or across multiple pages)? Since this website is brand new (zero links), would it make sense to nofollow all of the internal links so that they homepage can gain ranking as quickly as possible within Google?
Web Design | | wlw20090 -
Changing URL's for a website redesign
Hi folks, We're redesigning our website and looking for some advice on how changing our URL's would affected our rankings. If the page URLs are changing how can we carry out redirects to avoid losing any SEO rank? Thanks, Ross
Web Design | | Will_Craig0 -
Has Anyone Had Issues With ASP.NET 4.0 URL Routing?
I'm seeing some odd results in my SEOMOZ results with a new site I just released that is using the ASP.NET 4.0 URL routing. I am seeing thousands(!) of duplicate results, for instance, because the crawl has uncovered something like this: http://www.mysite.com/
Web Design | | TroyCarlson
http://www.mysite.com/default.aspx (so far, so good, though I wish it wouldn't show both)
http://www.mysite.com/default.aspx/about/ (what the heck -?)
http://www.mysite.com/default.aspx/about/about/ (WTF!?)
http://www.mysite.com/default.aspx/about/about/products/ (and on and on ad infinitum) I'm also seeing problems pop up in my sitemap because extensionless urls have an odd "eurl.axd/abunchofnumbersgohere" appended to the end of every address which is breaking links. sigh Buyer beware. I've found articles that discuss the "eurl.axd" issue here and there (this one seems very good), but nothing about the weird crawl issue I outlined above. Any advice?0 -
Site-wide footer links or single "website credits" page?
I see that you have already answered this question before back in 2007 (http://www.seomoz.org/qa/view/2163), but wanted to ask your current opinion on the same question: Should I add a site-wide footer link to my client websites pointing to my website, or should I create a "website credits" page on my clients site, add this to the footer and then link from within this page out to my website?
Web Design | | eseyo0