Free Article Previews (Free Registration Wall)
-
My site is www.optionmonster.com It has a few different areas of "Free" and "Premium" content.
1. We have a first click free program for Google visitors, where they can read the first news article in full.
2. Other visitors and subsequent news article views have a content preview, which includes headline and first paragraph of content, and then asks for a name and email address in order to consume the rest of the free news.
3. We have premium content (paid), and all of those folders are currently on our robots.txt file
My questions are as follows....
a. How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
b. Should I make the premium content a robots meta noindex tag, or because you can't see the article at all without logging in, is a proper place to include on robots.txt
-
Since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file?
You are indeed correct the best practice is to minimize your robots.txt file. That is why the very first sentence in my initial response was the suggestion to NOT include your premium sections in the robots.txt file
Will google and other bots will hurt you if you have premium sections that they try to crawl but can't?
No.
-
Okay. But since GoogleBots can't access the premium regardless, is it redundant to have on the robots.txt file? I thought the best practice was to have almost nothing on the robots.txt file per (http://www.seomoz.org/blog/serious-robotstxt-misuse-high-impact-solutions)
So my question comes down to if google and other bots will hurt you if you have premium sections that they try to crawl but can't, vs ignoring them because they are on the robots.txt
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
I am not sure what I said to offer that impression.
By "those pages" I am guessing you are referring to your premium content? If so, it really doesn't matter what you do with the content as Google can't get to it due to the robots.txt file. Even if you change the meta tag, Google wont be able to see the change.
Yes, it is possible they could try to follow a link but since this is premium content, they wont be able to access it.
Perhaps I am not clear on your Free vs Premium division. In short, any content which you do not desire to be indexed should contain the NoIndex tag, but that only applies if a crawler has access to the content.
-
So you wouldn't No index FOLLOW those pages, in case someone links to them?
-
I would not include your premium area in the robots.txt file at all. Google will recognize that they are unable to access the content, and it won't get indexed. There is no need to block it further.
For your other content, as long as you are showing Google the same exact information as you are showing to other visitors, you are fine. If you show Google more then you do to other visitors, then your site can be blacklisted.
How much content is needed in front of the "pay/reg wall" in order to still get proper juice from linkbacks/pagerank crawls
There are many factors involved. There isn't an answer like "400 words and you are good". These type of setups can be tricky. If you have a forum, then you can allow visitors to see the first thread but not any of the replies. By limiting content based on a number of words, you will be cutting off some articles, and it is possible a small article can be viewed in it's entirety.
It is more important your key words are in the content. If I linked to an article with the anchor text of 1980 Corvette, and your article started off discussing cars but you cut it off before discussing the 1980 Corvette, then that link can be devalued.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blog article cannibalizes our home page
Hello there, We're having a rather big SEO issue that I’m hoping someone here can help us with, perhaps having experienced the same thing or simply understanding what's going on. Since around June, our website's home page has lost the majority of its most important rankings. Not just dropping, but losing them entirely and all at once. We think it was self-inflicted: Almost at the same time, a blog article of ours (which we had recently updated) started ranking for almost all the same keywords. While our home page is a commercial page highlighting only our own product, the article that usurped the position is a comparison article, comparing our own solution to competitors. The reason we created that article is because we noticed a trend of Google increasingly favoring such comparison articles over dedicated product pages. But of course we didn’t plan to cannibalize our own home page with it. My question is whether anyone has experience with such a case? Is there a way to "tell"/influence Google to rank our home page again, instead of ranking that article? Thanks a lot, Pascal
Technical SEO | | Maximuxxx1 -
JSON-LD meta data: Do you have any rules/recommendations for using BlogPosting vs Article?
Dear Moz Community. I'm looking at moving from in-line Microdata in the HTML to JSON-LD on the web pages that I manage. Seems a far simpler solution having all the meta data in one place - especially for trouble shooting! With this in mind I've started to change the page templates on my personal site before I tackle the ones for my eCommerce site. I've made a start, and I'm still working on the templates producing some default values (like if a page doesn't have an associated image) but have been wondering if any of you have any rules/recommendations for using BlogPosting vs Article? I'd call this type of page an Article:
Technical SEO | | andystorey
https://cycling-jersey-collection.com/browse-collection/selle-italia-chinol-seb-bennotto-1982-team-jersey Whereas this page is from the /blog so that should probably be a BlogPosting:
https://cycling-jersey-collection.com/blog/2017-worldtour-team-jerseys I've used the following resources but it would be great to get a discussion on here.
https://yoast.com/structured-data-schema-ultimate-guide/
https://developers.google.com/search/docs/data-types/data-type-selector
https://search.google.com/structured-data/testing-tool/u/0/ I'm keen to get this 100% right as once this is done I'm going to drive through some further changes to get some progress on things like this: https://moz.com/blog/ranking-zero-seo-for-answers
https://moz.com/blog/what-we-learned-analyzing-featured-snippets Kind Regards andy moz-screenshot.jpg1 -
Should summary pages have the rel canonical set to the full article?
My site has tons of summary pages, Whether for a PDF download, a landing page or for an article. There is a summary page, that explains the asset and contains a link to the actual asset. My question is that if the summary page is just summary of an article with a "click here to read full article" button, Should I set the rel canonical on the summary page to go to the full article? Thanks,
Technical SEO | | Autoboof0 -
Articles and what to do with them
I realise there is a wealth of information out there regarding content etc. But Im getting slightly confused about what to do with my articles for my site. Each week we have 3 articles written, 2 x 300 word articles and 1 x newsletter The question is what the heck do i do with these I apologies but I'm so confused. Do I publish them to my site?
Technical SEO | | NickKer
Get them on a blog?
Publish them on a forum How many times do i get them published and whats the best way, and after all this , is this the right thing that Iam doing, and what else can i do to a) attract back links with this content
b) get it published
c) get google to index this and benefit from the content sorry if this has been repeated , but different people/companies offering different advice. Thanks1 -
My Article Post Title in both the h1 and the h2 are the same. Is this good seo?
I'm seeing a common practice in wordpress themes where the h1 tag for a page has the logo in it, then the h2 would be the title to the article. I've decided to place the title in the h1 dynamically, like this: - Joe's Auto Store where '' is the actual title to the post - the logo is still being used as a background image in the h1... So for example, the page would show this: How install a car battery - Joe's Auto Store I think this is good seo still, but the other issue is that the first, subsequent also has the exact same title because this is the actual post title, which uses the first h2 on the page to display the title. So the code would look like this: - My Company paragraph content text stuff an example would be How install a car battery - Joe's Auto Store How install a car battery At Joe's we teach how to install batteries on site. There are mor...(etc.) Is this an issue since the post title in both the h1 and h2 are nearly the same (except for the company name)? Is this good seo still?
Technical SEO | | johnnydigital0 -
Free Blogs Backlinks
Hello I have a very basic question, hope you people don't mind answering this. I plan to create a 10 blogs with keyword specific domain name, where in footer i can place back-link pointing to my website and thought to run on C-Class IP's which will cost me of-course. Now 2nd option which will be free, where i can plan to have my blog on wordpress, Timblr, blogger etc free blogging website and use the backlinks from there and all will have different IP which will also best for SEO prospective. Can you suggest me which will be the best option to have blogs on owned domain name or free blogging site, keeping in mind this will be just s prospective to generate backlinks. Do recommend is this a genuine way to get backliks or its another spam, and where we will keep on updating the all blogs regularly. Thanks in Advance! Regards Danish Wadhwa
Technical SEO | | DanishWadhwa0 -
Article Marketing for Backlinks
Ok I know there's a lot of information already on here about Article Marketing for SEO, but I need to know if anyone here has recently ran an article campaign successfully? Correct me if I am wrong, but submitting the same article to a bunch (more than 1-2) article directories for back links is a bad idea. Right? Maybe it worked in 2006, but now even the site themselves (Article Directories) are just so polluted with spam from the pass that, that Even if you submitted a genuine article.. it would still not give you as much Juice because the sites themselves are considered spamy. Looking at Alexa's ranking of Ezine Articles kind of proves that, after Panda Hit. The bottom line is, my boss says I have to start writing articles for backlinks. He wanted me to blast them across multiple directories. So I need to be absolutely certain that where I place these articles will have Quality impact on our sites SEO. Tips, Advice, Links, THANKS! We are a prominent ecommerce site in the food service industry.
Technical SEO | | Burkett.com0 -
Is it Panda?, how to deal with AP etc newswire articles
A site I have lost 30% of its traffic in June then another 10% in July, is it Panda? The site has 10's of thousands of AP or other syndicated articles on it, they are not there for SE benefits, they are categorized and relevant to the people who read them, the site gets half of its traffic from type ins/bookmarks. Should I nofollow the articles or rel="canonical" them? what can help...... Cheers
Technical SEO | | adamzski0