Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Client Portal and SEO Considerations?
-
Hi Moz and Moz fans,
We are looking to add a client portal to the website. Basically, I haven't found too much on this with regard to SEO. The idea would be that certain parts of the website would be hidden under a pay wall and for subscribers, they would be able to see all content. I am wondering if anyone has any experience with that and what SEO considerations to take into account.
One thing we are particularly concerned about is how Google will index the portions of the website behind the pay wall, if at all. Obviously, we would rather that they don't index it, so that people can't find a way to get to the info without paying. I would imagine it would have to do with the type of coding, however, I am not a coding guru, so I am not 100% on that.
Anyway, anyone that has any experience in this kind of thing and can comment on this at all, any comment is welcome. Also, any documentation that could be helpful would be welcome too.
Thanks
-
Hi Sergey,
Thanks for this. I have read that article at some point a while back. Interesting read. I was just sort of sounding out a few ideas in my last post. The second option seems to be the best way to go.
Do you know of any other methods to do this that is common in the industry?
Thanks,
Brian -
Hi Brian,
Google can definitely crawl Javascript, although it is limited in a sense. Here is a great article addressing this.
I have seen many websites use the solution that you mention in your second paragraph. That is, creating a separate section of the domain (or creating a subdomain) for users who are logging in. GoogleBot will not be able to crawl anything that is beyond a login portal, so this is the most common solution. Of course you can also disallow the specific path or subdomain in robots.txt as well!
It comes down to how much content that you have behind the login portal. You want to figure out which part of your site you want to be crawled, and which parts you don't want. After that point it's a matter of figuring out the best solution for blocking that content from crawlers.
Hope that helps!
-
Hi Andy,
Thanks for the reply.
This documentation was helpful. You mentioned the potential for the content to be seen in the cached version of pages. I read the Search Engine Land article there and shes sort of getting at how you don't want to block your content to search engines because then they can't be indexed and ranked. Let's say we don't really care about those parts of the pages that we wan't to block in terms of being indexed, which I sort of mentioned above. If we were to some how display those parts of the pages, images and text, in JavaScript, search engines wouldn't be able to crawl. Would those portions of the page still be visible in the cached version? I would imagine not if the search engines can't crawl JS, but not sure.
A second option I thought of was to create a separate subdomain for logged in users that would only be accessible through a log in form. Search engines cannot follow forms, so I would imagine, that gated content wouldn't be visible to crawlers and therefore not indexed. You could go one step farther and block the subdomain in robots.txt. Do you think that could be a possible solution?
Thanks again for the reply last week.
-Brian
-
Hi Brian,
I have a client working on correcting this issue with his site at the moment. They run a big media site that allows access once paid, but so may of these sites suffer with the same issue and because they allow Google to index the whole text, but only show a portion of it, this means that if you just look at the cached version, you can read it without paying.
In terms of correcting it, I would first have a read on how Google handles subscription sites. You can find that info here. Google prefers the "First click free" model.
There is additional reading on this subject over at Search Engine Land. First Click Free (FCF) is what you want to be looking into in more detail.
I hope this helps a little.
-Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Mega Menus and SEO
Hi Everyone, I know this has been brought up before, but wanted your opinion for 2020. I have a new client that is hesitant to do a mega menu for their huge site due to the amount of links and "dilution". I have quite a few clients with mega menus with no problems at all from an SEO standpoint. But I can understand his perspective. I am suggesting that we have the main links (looking at GA) as the the navigation, then clicking them takes you to subcategory page listing all the subcats within. Problem is that the developer/designer has made this mega menu already and it is pretty slick. Now they already are killing it search-wise on Google, but don't have a mega menu or a secondary category page. Just a a category with too many products, so we are trying to go one way or the other. Any opinions on which route to best take from a user and SEO perspective?
Web Design | | vetofunk0 -
How do elements that are displayed when scrolled impact SEO?
Hi, We are wanting to implement Animate.css and Wowjs on our site and were concerned about the SEO impacts. Basically when the page is loaded, if the element is not within the viewport then the HTML tag (i.e. div tag) have a style="visibility: hidden" and once the element is within the viewport it will change to have style="visibility: visible". Would having the style="visibility: hidden" negatively impact SEO?
Web Design | | KendallHershey0 -
Are Carousels Bad for SEO?
My real estate web site was migrated form Drupal to Wordpress last July. The ranking have dropped a lot since migration. One of the things we changed is that we have added two carousels to the home page. Most of the text is below the carousels. Is this bad for SEO? Thanks,
Web Design | | Kingalan1
Alan1 -
SEO Issues From Image Hotlinking?
I have a client who is hotlinking their images from one of their domains. I'm assuming the images were originally stored on the first domain (let's call it SiteA.com) and when they were putting together SiteB.com, they decided to just link to the images directly on SiteA.com instead of moving the images to Site B. Essentially hotlinking. Site A is not using the images in any way and in essence is just a gateway for their other sites and in this case a storage for their images. It doesn't use those images at all, so it really doesn't get any benefits of the images being referenced since I read that Google sometimes counts that hotlinking as a "vote" for the original image. But again, since ite A doesn't use the images that are being hotlinked at all, there's no benefit for Site A. My concern is that it's affecting their SEO for Site B because it makes it look like Site B is simply scraping data by hotlinking those images from Site A. Their programmer suggested creating a virtual directory so that it "looked" like it was coming from Site B. My guess is that Google can see this, so then not only will it look like Site B is scaping/hotlinking images, but also trying to hide it which may send up red flags to Google. My suggesstion to them was to just upload the images correctly into their own images directory on Site B. They own the images, so there's not any copyright issue, but that if they want proper SEO credit for that content, it all needs to be housed on the correct server and not hotlinked. Am I correct in this or will the virtual directory serve just as well?
Web Design | | GeorgiaSEOServices1 -
Html 5 main and secondary navigation for SEO best performances
I am building a website which will have a main navigation related to the site and each link of the main navigation will have a secondary navigation. We do not want to use a megamenu style navigation. I will try to explain it with a example: Let's start with an example for a computer store "My PC Store", the Main Navigation would be: Desktop PC's Notebook & Tablets
Web Design | | netbuilder
Multimedia When clicking on the "Notebook & Tablets" the user is directed to the page domain.com/notebook-tablet.html and on this page the secondary navigation appears: Laptop Netbook Tablets / iPad I am confused on how I should organize the semantic navigation for best SEO performances and I need advice / suggestions. I thought about 2 different ways to do it but which one is more appropriate in terms of SEO? PROPOSITION A Home Page: <header> My PC Store <nav> Desktop PC's Notebook & Tablets Multimedia </nav> </header> Sub-Page (Notebook & Tablets): <nav>(or <aside>?) Desktop PC's Notebook & Tablets Multimedia </aside> </nav> <header> Notebook & Tablets <nav> Laptop Netbook Tablets / iPad </nav> </header> As you notice on the home page the Main Site Navigation is included in the <header>while it is not in the sub-pages. PROPOSITION B Home Page: <header> My PC Store <nav> Desktop PC's Notebook & Tablets Multimedia </nav> </header> Sub-Page (Notebook & Tablets): <header> Notebook & Tablets <nav> Desktop PC's Notebook & Tablets Multimedia </nav> # Notebook & Tablets * Laptop Netbook Tablets / iPad </header> The main navgation remains always in the <header>(home page / sub-pages) of all page. I need suggestions... How would you guys organize the nav ? </header> </header>0 -
SEO and Server Connectivity....
Good Morning/Evening Mozzers, I arrive at work this morning with 5 emails from GWT for my separate domains reading, **"Googlebot can't access your site - **Over the last 24 hours, Googlebot encountered 39 errors while attempting to connect to your site. Your site's overall connection failure rate is 15.1%." I have passed this on to the Web Dev team to resolve ASAP. My Question, will server connectivity issues harm my rankings? Is there a danger if this continues that URL's could be de-indexed? Input would be greatly appreciated.
Web Design | | RobertChapman0 -
Javascript, PhP and SEO Impact?
What are the Pro's and Con's of using Java Script and PHP in a site when factoring in SEO?
Web Design | | bronxpad0 -
Should I Remove URL extentions for SEO?
We are having a developer design our website with Magento. I noticed the main pages such as About Us have no file extention in the URL. But the product pages have a .html file extention. I was once told to remove the file extentions. Are there benefits to removing the .html file extension and if so, is there a way we can do this using Magento?
Web Design | | hfranz0