Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Client Portal and SEO Considerations?
-
Hi Moz and Moz fans,
We are looking to add a client portal to the website. Basically, I haven't found too much on this with regard to SEO. The idea would be that certain parts of the website would be hidden under a pay wall and for subscribers, they would be able to see all content. I am wondering if anyone has any experience with that and what SEO considerations to take into account.
One thing we are particularly concerned about is how Google will index the portions of the website behind the pay wall, if at all. Obviously, we would rather that they don't index it, so that people can't find a way to get to the info without paying. I would imagine it would have to do with the type of coding, however, I am not a coding guru, so I am not 100% on that.
Anyway, anyone that has any experience in this kind of thing and can comment on this at all, any comment is welcome. Also, any documentation that could be helpful would be welcome too.
Thanks
-
Hi Sergey,
Thanks for this. I have read that article at some point a while back. Interesting read. I was just sort of sounding out a few ideas in my last post. The second option seems to be the best way to go.
Do you know of any other methods to do this that is common in the industry?
Thanks,
Brian -
Hi Brian,
Google can definitely crawl Javascript, although it is limited in a sense. Here is a great article addressing this.
I have seen many websites use the solution that you mention in your second paragraph. That is, creating a separate section of the domain (or creating a subdomain) for users who are logging in. GoogleBot will not be able to crawl anything that is beyond a login portal, so this is the most common solution. Of course you can also disallow the specific path or subdomain in robots.txt as well!
It comes down to how much content that you have behind the login portal. You want to figure out which part of your site you want to be crawled, and which parts you don't want. After that point it's a matter of figuring out the best solution for blocking that content from crawlers.
Hope that helps!
-
Hi Andy,
Thanks for the reply.
This documentation was helpful. You mentioned the potential for the content to be seen in the cached version of pages. I read the Search Engine Land article there and shes sort of getting at how you don't want to block your content to search engines because then they can't be indexed and ranked. Let's say we don't really care about those parts of the pages that we wan't to block in terms of being indexed, which I sort of mentioned above. If we were to some how display those parts of the pages, images and text, in JavaScript, search engines wouldn't be able to crawl. Would those portions of the page still be visible in the cached version? I would imagine not if the search engines can't crawl JS, but not sure.
A second option I thought of was to create a separate subdomain for logged in users that would only be accessible through a log in form. Search engines cannot follow forms, so I would imagine, that gated content wouldn't be visible to crawlers and therefore not indexed. You could go one step farther and block the subdomain in robots.txt. Do you think that could be a possible solution?
Thanks again for the reply last week.
-Brian
-
Hi Brian,
I have a client working on correcting this issue with his site at the moment. They run a big media site that allows access once paid, but so may of these sites suffer with the same issue and because they allow Google to index the whole text, but only show a portion of it, this means that if you just look at the cached version, you can read it without paying.
In terms of correcting it, I would first have a read on how Google handles subscription sites. You can find that info here. Google prefers the "First click free" model.
There is additional reading on this subject over at Search Engine Land. First Click Free (FCF) is what you want to be looking into in more detail.
I hope this helps a little.
-Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Location of body text on page - at top or bottom - does it matter for SEO?
Hi - I'm just looking at the text on a redesigned homepage. They have moved all the text to the very bottom of the page (which is quite common with lots of designers, I notice - I usually battle to move the important text back up to the top). I have always ensured the important text comes at the top, to some extent - does it matter where on the page the text comes, for SEO? Are there any studies you can point me to? Thanks for your help, Luke
Web Design | | McTaggart2 -
Community Discussion: UX & SEO – Your experience?
We've been looking at the relationship between SEO & UX a bit more closely lately on the blog. Our good pal Cyrus started the wheels turning with a tweet: https://twitter.com/CyrusShepard/status/748296076411625473 ...and that morphed into a Whiteboard Friday idea, which was filmed and posted here: https://moz.com/blog/ux-vs-seo-whiteboard-friday We shared the story of one site that enjoyed rapid growth and that subsequently battled with managing that UX/SEO relationship on Thursday. And it's hard, right? UX and SEO teams often operate independently of one another, and may make decisions that affect one another's work. Sometimes it's a "hindsight is 20/20" situation. Sometimes the answer is so radical and impactful that you may want to settle for a "safe" alternative. I'd imagine many of you have encountered some big issues with user experience and search optimization in your day-to-day over the years. What's the most difficult situation you've encountered with this? How did you resolve it? (I'd bet money on there being some really creative solutions out there :). Is there a particularly challenging situation you're struggling with now that you'd want to share & crowdsource ideas for?
Web Design | | FeliciaCrawford3 -
Old site to new WordPress site - Client concerned about Yahoo Ranking
Hello, Back Story I have a client (law firm) who has a large .html website. He has been doing his own SEO for years and it shows. I think the only reason he reached out to a professional is because he got a huge penalty from Google last fall and fell very far down in rankings. Although, he still retains a #1 spot in Yahoo for his site for the keyword phrase he wants. I have been creating a new WordPress theme for the client and creating all new pages and updating the formatting/SEO. From the beginning I have told the client that when we delete the old site and install a new WordPress site (same domain name, but different page hierarchy) he will take a bump in the search engines until all the 301 redirects get sorted out. I told him I can't guarantee any time frame of how long the dip in SEO will last. Some sites bounce right back while others take longer. Last week, during a discussion, he tells me that if he loses his #1 ranking on Yahoo for any length of time he thinks he will go out of business. Needless to say I was a little taken back. When it comes to SEO I use best practice techniques, do my research, stay on top of trends but I never guarantee rankings when moving to a new site. I'm thinking of ways I can help elevate any type of huge SEO drop off and help the client. Here is what I was thinking of suggesting to the client and I would love some feedback. Main Question He has another domain he isn't doing anything with. It's pretty much his domain name with pc added. I was thinking about using that domain to create a simple 1-2 page WordPress website with brand new content (no duplicate content) aimed at attracting his keyword phrase. I would do as much SEO as I could with a 1-2 page site and give it a month or so to see if this smaller site can get into the top #10 in Yahoo, or higher. Then, when we move the site he will still have a website on the first page of Yahoo for his keyword phrase. I hope I explained it clearly 🙂 I would be open to any suggestions anyone may have. Thanks
Web Design | | Bill_K0 -
Too Many Outbound Links on the Home Page - Bad for SEO?
Hello Again Moz community, This is my last Q of the day: I have a LOT of outbound links on the home page of www.web3.ca Some are to clients projects, most are to other pages on the website. Can reducing this to the core pages have a positive impact on SEO? Thanks, Anton
Web Design | | Web3Marketing870 -
SEO and Squarespace? Is this Really an Option?
Hi all, Any feedback on Squarespace, SEO capabilites and ranking factors? I have a client wishing to use the platform and despite the good reviews, which appear to be from resellers by the way, the forums say not. Although apparently Rand Fishkin, SEOMoz (yes right here!) gave them a big thumbs up “The square space team have put together a remarkable platform, SEO friendliness! Really not sure here and don’t agree, there are many limitations and hosting with a template provider is always big no no. Cheers
Web Design | | VirginiaC
Virginia0 -
Site Activity, SEO, and behind login
I have a site that provides online education and as such, most of the user activity happens behind a login. This has me thinking about potential SEO impacts with a few questions that maybe someone could lend some light on: How important is activity (above just search activity) to the search engines Would it help to enter these pages, even though they're behind a login, into GA as we have with the front-end of the site Does a subdomain make a difference (right now we implement the course as a subdomain of the main site Lastly, as I was looking at compete.com, I am wondering how they get these use statistics?
Web Design | | uwaim20120 -
What is the difference of HTML5 and web 2.0? What is web 2.0 and is this better for seo?
A little bit confused with the new stuff. The web 2.0 webpages are so much better? What changes?
Web Design | | Naghirniac0 -
Combining web pages and it's affects on SEO?
We are looking into amending a website we are working on to try and combine 2 or 3 current pages onto one page. This site is similar to an estate agents site and currently has images, map, floor plan sub pages etc. Can anyone tell me, if we were to combine these pages and include the above details on one page, how that would affect the current search engine rankings?
Web Design | | SoundinTheory0