Noindex, nofollow on a blog since 2009
-
Just reviewed a WordPress blog that was launched in 2009 but somehow the privacy setting was to not index it, so all this time there's been a noindex, nofollow meta tag in the header. The client couldn't figure out why masses of content wasn't showing up in search results.
I've fixed the setting and assume Google will spider in short order; the blog is a subdirectory of their main site. My question is whether there is anything else I can or should do. Can Google recognize the age of the content, or that it once had a noindex meta tag? Will it "date" the blog as of today? Has the client lost out on untold benefits from the long history of content creation? I imagine that link juice from any backlinks to the blog will now flow back to the main site; think that's true?
Just curious what others might think of this scenario and whether any other action is warranted.
-
Thanks Dan. One thing I found interesting is that Google Webmaster Tools doesn't offer any alerts about pages that aren't indexed because of meta tags, only about those included in the robots.txt file.
-
Hi
Great responses Matt and Ben, thanks!! Only things I could add are;
Webmaster Tools
- Check google webmaster tools every few days for the first 2-3 weeks.
- You may turn up some 404s or other types of errors that should be corrected.
- And keep your eyes out for any other warnings
Analytics
- You're going to spike your traffic (potentially, hopefully) in analytics big time, or at least skew the data
- Use filters and advanced segments to separate blog traffic so you can still analyze things even after a potential spike in blog search traffic.
- At minimum make an annotation of the date you made it indexable.
Dates
- Regarding the dates, I did come across this recently - I have not tested, so please take it with a grain of salt - removing dates from the SERPs - I would only recommend trying it if the content was not "time sensitive" (like a cooking recipe).
Hope all this helps!
-Dan
-
Thanks for the clarification Ben. I think I'll leave older posts as is. They've been actively posting several times a week, so there should be enough fresh content. My hope is that Google recognizes the age of the blog because it's my understanding that age factors in the ranking algorithm.
-
Ahh yeah my bad, ignore that bit. I think you'd still want to make a subtle change to each post so WordPress can set the date updated flag on the sitemap to today, that way Google will put a higher priority on the content when indexing your site.
-
Thanks, the site maps are a good idea. Ben, I'm not sure what you mean about making the content different to what Google has in its index. Because of the meta tag, it doesn't have any content in its index, right?
-
You've done the most important step (removing the noindex/nofollow) tags. The only additional thing I would do is submit (or resubmit) the XML sitemap to Google. Make sure that XML sitemap is perfect and error free so that you don't create any additional errors.
Google should be smart enough to recognize the dates. I've never had a situation where it was years between publish and index. I have however had situations where it was days or weeks in between publish and index and in those situations Google has recognize the date. I'd imagine the same is true here (assuming of course, you have the date in a recognizable format and don't change the date to today).
I'd be curious to find out what happens. Definitely update this Q&A when you find out what happens!
-
I would probably re-arrange some of the paragraphs (or add some more content) to the old posts and update them in WordPress, this then makes the content different to what Google has in its index.
I would then use the Yoast WordPress SEO plugin to regenerate your sitemap. Since you've updated and added new content to the posts their last updated date would have changed so Google will probably see this as revised content. I would submit to all major search engines as your first port of call.
In terms of the "link juice", I would say that Google will still count links to the article as a ranking factor, but because you have noindex the content wont appear in search results. So the content will have a fairly good page rank (possibly) but its being held back by the exclusion of the search engine index.
Now that the setting has been changed and the sitemap / content has been updated you should start to see the results in the search results in due time.
You could also add a few new articles of content to the blog and publicise that over social media to help get back in the game a bit quicker.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Duplicate content, although page has "noindex"
Hello, I had an issue with some pages being listed as duplicate content in my weekly Moz report. I've since discussed it with my web dev team and we decided to stop the pages from being crawled. The web dev team added this coding to the pages <meta name='robots' content='max-image-preview:large, noindex dofollow' />, but the Moz report is still reporting the pages as duplicate content. Note from the developer "So as far as I can see we've added robots to prevent the issue but maybe there is some subtle change that's needed here. You could check in Google Search Console to see how its seeing this content or you could ask Moz why they are still reporting this and see if we've missed something?" Any help much appreciated!
Technical SEO | | rj_dale0 -
Should I nofollow/noindex the outgoing links in a news aggregator website?
We have a news aggregator site that has 2 types of pages: First Type:
Technical SEO | | undaranfahujakia
Category pages like economic, sports or political news and we intend to do SEO on these category pages to get organic traffic. These pages have pagination and show the latest and most viewed news on the corresponding category. Second Type:
News headlines from other sites are displayed on the category pages. The user will be directed to that news page on the main site by clicking on a link. These links are outgoing links and we redirect them by JavaScript (not 301).
In fact these are our websites articles that just have titles (linked to destination) and meta descriptions (reads from news RSS). Question:
Should we have to nofollow/noindex the second type of links? In fact, since the crawl budget of websites is limited, isn't it better to spend this budget on the pages we have invested in (first type)?0 -
Organic search traffic has dropped by 35% since 18 September, we don't know why.
Organic traffic to our website has dropped 35% since 18 September 2017 to date. From 1 January to 18 September 2017 organic traffic was up by just under 1% over all (Google up by 1.32%). Paid search traffic over the same time has remained steady. There is nothing we can think of that we've done that has caused the drop. We had an issue with Google page speed test failing when running a test but we resolved this issue on 20 November and in that time we've seen an even greater drop (44% in the last week). The drop is seen across the 3 main search engines, not just Google, which points toward something we've done, but as mentioned, we can't think of any significant change we made in September that would have such negative effects. There is little difference across devices. Is anyone aware of a significant event in September in the search engine world that may have influenced our organic traffic? Any help gratefully received.
Technical SEO | | imaterus0 -
Google Appending Blog URL inbetween my homepage and product page is it issue with base url?
Hi All, Google Appending Blog URL inbetween my homepage and product page. Is it issue or base url or relative url? Can you pls guide me? Looking to both tiny url you will get my point what i am saying. Please help Thanks!
Technical SEO | | amu1230 -
Nofollow links on our site menu
Hi Our site's front page has almost 900 internal links on it (it's an ecommerce site with about 25,000 products). A lot of these are on a pretty involved dropdown menu, which is on every page. I can't really do anything to get this figure down (its outside my remit), but one thing the developers have done is make all the menu links nofollow on the mobile version of the menu (site is responsive) - otherwise there would be even more links! My question is as to whether doing this for the mobile menu is a good idea, in terms of SEO?
Technical SEO | | abisti21 -
How to avoid duplicate content when blogging from a site
I have a wordpress plastic surgery website. I have a wordpress blog on the site. My concern is avoiding duplicate content penalties when I blog. I use my blog to add new information about procedures that have pages on the same topic on the main site. Invariably same keywords and phrases can appear in the blog-will this be considered Duplicate content? Also is it black hat to insert anchor text in a blog linking back to site content-ie internal link or is one now and then helpful
Technical SEO | | wianno1680 -
Doubt between sub-directory and sub-domain for develop Blog for my business website
Hi, I am much aware with SEO. But still there is a confusion in my mind. I am in the process of making blog for my Business website. I am confused between whether my blog should be with sub-directory(www.metaoption.com/ blog) or with sub-domain(blog. metaoption.com). There are many articles on this topic but they have created much confusions. Please suggest me the best option and also give me reason behind it if you can. Thanks
Technical SEO | | Perfect0070 -
How to change noindex to index?
Hey, I've recently upgraded to a pro SEOmoz account and have realised i have 14574 issues to do with 'blocked by meta-robot' and that 'This page is being kept out of the search engine indexes by the meta tag , which may have a value of "noindex", keeping this page out of the index.' How can i change this so my pages get indexed? I read somewhere that i need to change my privacy settings but that thread was 3 years old and now the WP Dashboard has updated.. Please let me know Many thanks, Jamie P.s Im using WordPress 3.5 And i have the XML sitemap plugin And i have no idea where to look for this robots.txt file..
Technical SEO | | markgreggs0