Free Article Previews (Free Registration Wall)
-
My site is www.optionmonster.com It has a few different areas of "Free" and "Premium" content.
1. We have a first click free program for Google visitors, where they can read the first news article in full.
2. Other visitors and subsequent news article views have a content preview, which includes headline and first paragraph of content, and then asks for a name and email address in order to consume the rest of the free news.
3. We have premium content (paid), and all of those folders are currently on our robots.txt file
My questions are as follows....
a. How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
b. Should I make the premium content a robots meta noindex tag, or because you can't see the article at all without logging in, is a proper place to include on robots.txt
-
Since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file?
You are indeed correct the best practice is to minimize your robots.txt file. That is why the very first sentence in my initial response was the suggestion to NOT include your premium sections in the robots.txt file
Will google and other bots will hurt you if you have premium sections that they try to crawl but can't?
No.
-
Okay. But since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file? I thought the best practice was to have almost nothing on the robots.txt file per (http://www.seomoz.org/blog/serious-robotstxt-misuse-high-impact-solutions)
So my question comes down to if google and other bots will hurt you if you have premium sections that they try to crawl but can't, vs ignoring them because they are on the robots.txt
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
I am not sure what I said to offer that impression.
By "those pages" I am guessing you are referring to your premium content? If so, it really doesn't matter what you do with the content as Google can't get to it due to the robots.txt file. Even if you change the meta tag, Google wont be able to see the change.
Yes, it is possible they could try to follow a link but since this is premium content, they wont be able to access it.
Perhaps I am not clear on your Free vs Premium division. In short, any content which you do not desire to be indexed should contain the NoIndex tag, but that only applies if a crawler has access to the content.
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
-
I would not include your premium area in the robots.txt file at all. Google will recognize that they are unable to access the content, and it won't get indexed. There is no need to block it further.
For your other content, as long as you are showing Google the same exact information as you are showing to other visitors, you are fine. If you show Google more then you do to other visitors, then your site can be blacklisted.
How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
There are many factors involved. There isn't an answer like "400 words and you are good". These type of setups can be tricky. If you have a forum, then you can allow visitors to see the first thread but not any of the replies. By limiting content based on a number of words, you will be cutting off some articles, and it is possible a small article can be viewed in it's entirety.
It is more important your key words are in the content. If I linked to an article with the anchor text of 1980 Corvette, and your article started off discussing cars but you cut it off before discussing the 1980 Corvette, then that link can be devalued.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google rejected my reconsideration request of unnatural link manual action, and list one blog article twice as example?
Hi Moz Community, On April 22 my site received a manual action in Google Webmaster telling me it's caused by unnatural links. After some a deep cleaning of all the sitewide links, which I think is the major problem of my external links, I requested a reconsideration request on May 4. And Google rejected my reconsideration request of unnatural link manual action on May 29, and list one blog article twice as example, which is quite weird to me. Is it normal for Google to list one URL twice as example in the feedback? I don't quite see the reason for that. Does anybody have any idea about that? This is really quite frustrating to me. And to be honest, I don't see much problems about the article Google listed as well. Yeah it's all about our product and it has 3 do-follow links to our site. But it contains no words such as sponsor, advertisement, or rewards... And the blog itself is quite healthy as well. The post also get rather high engagement, with organic comments and shares. How did Google flag that out? I don't think it's possible that Google will go into all our site links one by one... Hope you guys can help me with that. Thanks in advance! Ben
Technical SEO | | Ben_fotor0 -
Google displays multiple titles for same article. What does this mean?
I've linked to some screenshots so that it what I'm talking about makes more sense. Sometimes, when I perform a search, I see an article with the correct article title listed as the page title in the SERPs. Other times, I see the wrong page title – it's a generic somethin' or other done by my client's web design company with a bunch of keywords thrown in. The latter (not the correct article title) also appears at the top of the browser tab for every article on my client's site. I know this is bad, but what can be done about it? This would never happen if my client used Wordpress or some easily modifiable CMS, but they're using a proprietary one maintained by the group that designed the website. open?id=0BxB_dYL1ylGgVVF1dHlwdXp2dFU open?id=0BxB_dYL1ylGgdWJjdlJoRlRIR00
Technical SEO | | Greenery0 -
URL Path to Store Article Library for SEO
What is the best URL structure for a domain to start adding a main directory for educational articles under? We want to find the best URL structure to keep articles under as a main, then category, then subcategory: For example, if my client is going after TWO SPECIFIC KEYWORD PHRASES as their primary (let's say they are KIDNEY DIALYSIS and CKD DIALYSIS, should they start building up their article library (for educational purposes as well as ranking/SEO), should they list it under which structure for the best SEO ranking opportunities: domain.com/KIDNEY-DIALYSIS/article1, article2, article3 domain.com/CKD-DIALYSIS/article1, article2, article3 domain.com/ARTICLES/article1, article2, article3 Both KIDNEY DIALYSIS and CKD DIALYSIS are critical phrases for them. Is it a waste of URL space to just have a home of domain.com/ARTICLES then build off that URL structure like: domain.com/articles/kidney-dialysis domain.com/articles/ckd-dialysis Thoughts? Ideas? Thank you!
Technical SEO | | ErnieB0 -
HELP! Google Business listing removed - check out my SERP free fall!
Hey Moz Community, I need your help. I have (had) a google local business listing. I made some changes last week to clean it up. Now it's gone and I've had a massive fall in my rankings (see images). Changes I made: I changed the business name from a spammy name: BYOL Graphic Design & Web Design Courses. TO: **Bring Your Own Laptop PTY LTD. ** I added Local business schema to my website. I added my telephone, address etc. Previously it was all an image. I tinkered with a few other things while I was there too but I can't remember them all. Other notes: Initially I blamed the dramatic drop on Hummingbird but after doing some research I'm not so sure. I think it's because I was messing around with Google Local. My listing is/was here: https://plus.google.com/111689574762050943425 (though it doesn't work any more). My website is www.bringyourownlaptop.com.au Questions: Do you think the loss of my Google local listing could be the cause of such a big drop? If it is my Google local listing - Is there a way to find out what I did wrong? Is there a place to ask for it to be re-checked? Is it better to just start again with a new listing? Do you think it's tied together with a Hummingbird change some how? What else can I check? What would you do? Thanks for your time. Dan
Technical SEO | | danlovesadobe
_The nervous business owner. _ InKrwvX.png Hv36XUu.png0 -
Is it worth adding schema markup to articles?
I know things like location, pagination, breadcrumbs, video, products etc have value in using schema markup. What about things like articles though? Is it worth all the work involved in having the pages mark up automatically? How does this effect SEO, and is it worthwhile? Thanks, Spencer
Technical SEO | | MarloSchneider0 -
Blog article URL - with or without date?
Quick question to all you folks: does including the date in a blog article's permalink affect rankings? For example, here's an article with the month and year, as well as the blog title: http://www.ayzanyc.com/blog/2012/12/difference-between-hot-chocolate-hot-cocoa/ Is it better to omit the date and just put the blog title? Also, if is better to avoid using the date, is it worth it to change the link structure of our previous articles (given that the URL will now be different), or should we just focus on future articles? Thanks ahead of time for your advice.
Technical SEO | | onurkiyak0 -
Links into website that are unnatural - a paid article
I prepared an article for another related website and posted it on my website - http://www.gardenbeet.com/garden_design_blog/garden-ideas/save-money-and-create-diversity-seeds-and-small-plants-are-better/ I was paid to write an article and provided a link to the related website at the end of the article - I declared the payment a good 10 months later the page where the article sits has become the 2nd most linked to page on my website - SEOmoz is giving it a Page Authority of 48 and all the links are coming from a wide variety of forums using one anchor text link phrase in the latest google update my homepage PR dropped by 1 - I am assuming the penalty came because of this article is it worth changing the URL to remove these spammy links to my website?
Technical SEO | | GardenBeet0 -
Does posting an article on multiple sites hurt seo?
A client of mine creates thought leadership articles and pitches multiple sites to host the article on their site to reach different audiences. The sites that pick it up are places such as AdAge and MarketingProfs and we do get link juice from these sources most of the time. Does having the same article on these sites as well as your own hurt your SEO efforts in any way? Could it be recognized as duplicate content? I know the links are great just wondering if there is any other side effects especially when there are no links provided! Thank you!
Technical SEO | | Scratch_MM0