The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. SEO and Digital Marketing Forum
    2. Categories
    3. SEO Tactics
    4. Intermediate & Advanced SEO
    5. Googlebot on paywall made with cookies and local storage

    Moz Q&A is closed.

    After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

    Googlebot on paywall made with cookies and local storage

    Intermediate & Advanced SEO
    3 2 1.9k
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with topic management privileges can see it.
    • OPU
      OPU last edited by

      My question is about paywalls made with cookies and local storage. We are changing a website with free content to a open paywall with a 5 article view weekly limit.

      The paywall is made to work with cookies and local storage. The article views are stored to local storage but you have to have your cookies enabled so that you can read the free articles. If you don't have cookies enable we would pass an error page (otherwise the paywall would be easy to bypass).

      Can you say how this affects SEO? We would still like that Google would index all article pages that it does now.

      Would it be cloaking if we treated Googlebot differently so that when it does not have cookies enabled, it would still be able to index the page?

      1 Reply Last reply Reply Quote 1
      • OPU
        OPU @CatalystSEM last edited by

        Thank you for your answer!

        Yes, that is exactly the case.

        We have been testing this and it seems that "Googlebot" doesn't hit the wall at all with the normal settings on. With these results it seems that we don't need to treat "Googlebot" differently because it doesn't seem to store any cookie or local storage data.

        Tech savvy users can bypass the pay wall by other means as well so that's not a big concern for us.

        1 Reply Last reply Reply Quote 0
        • CatalystSEM
          CatalystSEM last edited by

          To make sure that I'm getting your question correct. You want Google to crawl and index all your content but you want visitors to use an open paywall that shows 5 free articles then resorts to a paywall.

          Yes, it would be treated as cloaking but you have a legitimate reason for doing so and intent matters a great deal. You could check for a search engine user-agent string such as  "Googlebot" and then serve the full content. This would ensure that your content is still crawled and indexed.

          The only downside is any tech savvy individual can spoof the server header by setting their user-agent to "Googlebot" and bypass your paywall.

          OPU 1 Reply Last reply Reply Quote 0
          • 1 / 1
          • First post
            Last post

          Got a burning SEO question?

          Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


          Start my free trial


          Explore more categories

          • Moz Tools

            Chat with the community about the Moz tools.

            Getting Started
            Moz Pro
            Moz Local
            Moz Bar
            API
            What's New

          • SEO Tactics

            Discuss the SEO process with fellow marketers

            Content Development
            Competitive Research
            Keyword Research
            Link Building
            On-Page Optimization
            Technical SEO
            Reporting & Analytics
            Intermediate & Advanced SEO
            Image & Video Optimization
            International SEO
            Local SEO

          • Community

            Discuss industry events, jobs, and news!

            Moz Blog
            Moz News
            Industry News
            Jobs and Opportunities
            SEO Learn Center
            Whiteboard Friday

          • Digital Marketing

            Chat about tactics outside of SEO

            Affiliate Marketing
            Branding
            Conversion Rate Optimization
            Web Design
            Paid Search Marketing
            Social Media

          • Research & Trends

            Dive into research and trends in the search industry.

            SERP Trends
            Search Behavior
            Algorithm Updates
            White Hat / Black Hat SEO
            Other SEO Tools

          • Support

            Connect on product support and feature requests.

            Product Support
            Feature Requests
            Participate in User Research

          • See all categories

          • Googlebot being redirected but not users?
            Sayers
            Sayers
            0
            8
            2.2k

          • Mobile Googlebot vs Desktop Googlebot - GWT reports - Crawl errors
            Carla_Dawson
            Carla_Dawson
            0
            3
            2.2k

          Get started with Moz Pro!

          Unlock the power of advanced SEO tools and data-driven insights.

          Start my free trial
          Products
          • Moz Pro
          • Moz Local
          • Moz API
          • Moz Data
          • STAT
          • Product Updates
          Moz Solutions
          • SMB Solutions
          • Agency Solutions
          • Enterprise Solutions
          • Digital Marketers
          Free SEO Tools
          • Domain Authority Checker
          • Link Explorer
          • Keyword Explorer
          • Competitive Research
          • Brand Authority Checker
          • Local Citation Checker
          • MozBar Extension
          • MozCast
          Resources
          • Blog
          • SEO Learning Center
          • Help Hub
          • Beginner's Guide to SEO
          • How-to Guides
          • Moz Academy
          • API Docs
          About Moz
          • About
          • Team
          • Careers
          • Contact
          Why Moz
          • Case Studies
          • Testimonials
          Get Involved
          • Become an Affiliate
          • MozCon
          • Webinars
          • Practical Marketer Series
          • MozPod
          Connect with us

          Contact the Help team

          Join our newsletter
          Moz logo
          © 2021 - 2026 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
          • Accessibility
          • Terms of Use
          • Privacy

          Looks like your connection to Moz was lost, please wait while we try to reconnect.