Free Article Previews (Free Registration Wall)
-
My site is www.optionmonster.com It has a few different areas of "Free" and "Premium" content.
1. We have a first click free program for Google visitors, where they can read the first news article in full.
2. Other visitors and subsequent news article views have a content preview, which includes headline and first paragraph of content, and then asks for a name and email address in order to consume the rest of the free news.
3. We have premium content (paid), and all of those folders are currently on our robots.txt file
My questions are as follows....
a. How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
b. Should I make the premium content a robots meta noindex tag, or because you can't see the article at all without logging in, is a proper place to include on robots.txt
-
Since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file?
You are indeed correct the best practice is to minimize your robots.txt file. That is why the very first sentence in my initial response was the suggestion to NOT include your premium sections in the robots.txt file
Will google and other bots will hurt you if you have premium sections that they try to crawl but can't?
No.
-
Okay. But since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file? I thought the best practice was to have almost nothing on the robots.txt file per (http://www.seomoz.org/blog/serious-robotstxt-misuse-high-impact-solutions)
So my question comes down to if google and other bots will hurt you if you have premium sections that they try to crawl but can't, vs ignoring them because they are on the robots.txt
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
I am not sure what I said to offer that impression.
By "those pages" I am guessing you are referring to your premium content? If so, it really doesn't matter what you do with the content as Google can't get to it due to the robots.txt file. Even if you change the meta tag, Google wont be able to see the change.
Yes, it is possible they could try to follow a link but since this is premium content, they wont be able to access it.
Perhaps I am not clear on your Free vs Premium division. In short, any content which you do not desire to be indexed should contain the NoIndex tag, but that only applies if a crawler has access to the content.
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
-
I would not include your premium area in the robots.txt file at all. Google will recognize that they are unable to access the content, and it won't get indexed. There is no need to block it further.
For your other content, as long as you are showing Google the same exact information as you are showing to other visitors, you are fine. If you show Google more then you do to other visitors, then your site can be blacklisted.
How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
There are many factors involved. There isn't an answer like "400 words and you are good". These type of setups can be tricky. If you have a forum, then you can allow visitors to see the first thread but not any of the replies. By limiting content based on a number of words, you will be cutting off some articles, and it is possible a small article can be viewed in it's entirety.
It is more important your key words are in the content. If I linked to an article with the anchor text of 1980 Corvette, and your article started off discussing cars but you cut it off before discussing the 1980 Corvette, then that link can be devalued.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Should summary pages have the rel canonical set to the full article?
My site has tons of summary pages, Whether for a PDF download, a landing page or for an article. There is a summary page, that explains the asset and contains a link to the actual asset. My question is that if the summary page is just summary of an article with a "click here to read full article" button, Should I set the rel canonical on the summary page to go to the full article? Thanks,
Technical SEO | | Autoboof0 -
Syndicated content outranks my original article
I have a small site and write original blog content for my small audience. There is a much larger, highly relevant site that is willing to accept guest blogs and they don't require original content. It is one of the largest sites within my niche and many potential customers of mine are there. When I create a new article I first post to my blog, and then share it with G+, twitter, FB, linkedin. I wait a day. By this time G has seen the links that point to my article and has indexed it. Then I post a copy of the article on the much larger site. I have a rel=author tag within the article but the larger site adds "nofollow" to that tag. I have tried putting a link rel=canonical tag in the article but the larger site strips that tag out. So G sees a copy of my content on this larger site. I'm hoping they realize it was posted a day later than the original version on my blog. But if not will my blog get labeled as a scraper? Second: when I Google the exact blog title I see my article on the larger site shows up as the #1 search result but (1) there is no rich snippet with my author creds (maybe because the author tag was marked nofollow?), and (2) the original version of the article from my blog is not in the results (I'm guessing it was stripped out as duplicate). There are benefits for my article being on the larger site, since many of my potential customers are there and the article does include a link back to my site (the link is nofollow). But I'm wondering if (1) I can fix things so my original article shows up in the search results, or (2) am I hurting myself with this strategy (having G possibly label me a scraper)? I do rank for other phrases in G, so I know my site hasn't had a wholesale penalty of some kind.
Technical SEO | | scanlin0 -
Moving articles to new site, can't 301 redirect because of panda
I have a site that is high quality, but was hit by penguin and perhaps panda. I want to remove some of the articles from my old site and put them on my new site. I know I can't 301 redirect them because I will be passing on the bad google vibes. So instead, I was thinking of redirecting the old articles to a page on the old site which explains that the article is moved over to the new site. I assume that's okay? I'm wondering how long I should wait between the time I take them down from the old site to the time I repost them on the new site. Do I need to wait for Google to de-index them in order to not be considered duplicate content/syndication? We'll probably reword them a bit, too - we really want to avoid panda. Thanks!
Technical SEO | | philray
Phil0 -
Link to Articles for news sites in Google SERPs
I'm trying to figure out why when I search for "international news" or "world news", for example, some sites in the SERPs have links to news articles, while others don't. For "international news", result of Fox News and New York Times have links to articles, while CNN (the top result), only have sitelinks. I would appreciate any theories on why this happens. Thanks.
Technical SEO | | seoFan210 -
Free Joomla SEO Extension?
Hi all -- all along, I have used Tag Meta as a super simple Joomla extension to manage page titles. The most recent Joomla site I manage is using K2. The Tag Meta extension will install, but something with K2 is overriding the page titles that I put in. Thus, I am simply looking for a free (if at all possible) Joomla extension that will allow me to enter unique page titles for each page of the site without changing the Joomla page title of each page. Or, if anyone has had the same problem, I'm looking for a solution to make Tag Meta and K2 play nice. Any suggestions?
Technical SEO | | Bandicoot0 -
Free Blogs Backlinks
Hello I have a very basic question, hope you people don't mind answering this. I plan to create a 10 blogs with keyword specific domain name, where in footer i can place back-link pointing to my website and thought to run on C-Class IP's which will cost me of-course. Now 2nd option which will be free, where i can plan to have my blog on wordpress, Timblr, blogger etc free blogging website and use the backlinks from there and all will have different IP which will also best for SEO prospective. Can you suggest me which will be the best option to have blogs on owned domain name or free blogging site, keeping in mind this will be just s prospective to generate backlinks. Do recommend is this a genuine way to get backliks or its another spam, and where we will keep on updating the all blogs regularly. Thanks in Advance! Regards Danish Wadhwa
Technical SEO | | DanishWadhwa0 -
Google previews meanings
I have noticed that when I do a site:mysite.com search and all my indexed pages come up, that when I hover over the arrows and bring up the previews some of the pages have things in a red rectangle and some of the pages even have zig zag-like tears/perforations running through them. What do these signify?
Technical SEO | | VictorVC0 -
I am Posting an article on my site and another site has asked to use the same article - Is this a duplicate content issue with google if i am the creator of the content and will it penalize our sites - or one more than the other??
I operate an ecommerce site for outdoor gear and was invited to guest post on a popular blog (not my site) for a trip i had been on. I wrote the aritcle for them and i also will post this same article on my website. Is this a dup content problem with google? and or the other site? Any Help. Also if i wanted to post this same article to 1 or 2 other blogs as long as they link back to me as the author of the article
Technical SEO | | isle_surf0