Skip to content
    Moz logo Menu open Menu close
    • Products
      • Moz Pro
      • Moz Pro Home
      • Moz Local
      • Moz Local Home
      • STAT
      • Moz API
      • Moz API Home
      • Compare SEO Products
      • Moz Data
    • Free SEO Tools
      • Domain Analysis
      • Keyword Explorer
      • Link Explorer
      • Competitive Research
      • MozBar
      • More Free SEO Tools
    • Learn SEO
      • Beginner's Guide to SEO
      • SEO Learning Center
      • Moz Academy
      • MozCon
      • Webinars, Whitepapers, & Guides
    • Blog
    • Why Moz
      • Digital Marketers
      • Agency Solutions
      • Enterprise Solutions
      • Small Business Solutions
      • The Moz Story
      • New Releases
    • Log in
    • Log out
    • Products
      • Moz Pro

        Your all-in-one suite of SEO essentials.

      • Moz Local

        Raise your local SEO visibility with complete local SEO management.

      • STAT

        SERP tracking and analytics for enterprise SEO experts.

      • Moz API

        Power your SEO with our index of over 44 trillion links.

      • Compare SEO Products

        See which Moz SEO solution best meets your business needs.

      • Moz Data

        Power your SEO strategy & AI models with custom data solutions.

      Let your business shine with Listings AI
      Moz Local

      Let your business shine with Listings AI

      Learn more
    • Free SEO Tools
      • Domain Analysis

        Get top competitive SEO metrics like DA, top pages and more.

      • Keyword Explorer

        Find traffic-driving keywords with our 1.25 billion+ keyword index.

      • Link Explorer

        Explore over 40 trillion links for powerful backlink data.

      • Competitive Research

        Uncover valuable insights on your organic search competitors.

      • MozBar

        See top SEO metrics for free as you browse the web.

      • More Free SEO Tools

        Explore all the free SEO tools Moz has to offer.

      NEW Keyword Suggestions by Topic
      Moz Pro

      NEW Keyword Suggestions by Topic

      Learn more
    • Learn SEO
      • Beginner's Guide to SEO

        The #1 most popular introduction to SEO, trusted by millions.

      • SEO Learning Center

        Broaden your knowledge with SEO resources for all skill levels.

      • On-Demand Webinars

        Learn modern SEO best practices from industry experts.

      • How-To Guides

        Step-by-step guides to search success from the authority on SEO.

      • Moz Academy

        Upskill and get certified with on-demand courses & certifications.

      • MozCon

        Save on Early Bird tickets and join us in London or New York City

      Unlock flexible pricing & new endpoints
      Moz API

      Unlock flexible pricing & new endpoints

      Find your plan
    • Blog
    • Why Moz
      • Digital Marketers

        Simplify SEO tasks to save time and grow your traffic.

      • Small Business Solutions

        Uncover insights to make smarter marketing decisions in less time.

      • Agency Solutions

        Earn & keep valuable clients with unparalleled data & insights.

      • Enterprise Solutions

        Gain a competitive edge in the ever-changing world of search.

      • The Moz Story

        Moz was the first & remains the most trusted SEO company.

      • New Releases

        Get the scoop on the latest and greatest from Moz.

      Surface actionable competitive intel
      New Feature

      Surface actionable competitive intel

      Learn More
    • Log in
      • Moz Pro
      • Moz Local
      • Moz Local Dashboard
      • Moz API
      • Moz API Dashboard
      • Moz Academy
    • Avatar
      • Moz Home
      • Notifications
      • Account & Billing
      • Manage Users
      • Community Profile
      • My Q&A
      • My Videos
      • Log Out

    The Moz Q&A Forum

    • Forum
    • Questions
    • Users
    • Ask the Community

    Welcome to the Q&A Forum

    Browse the forum for helpful insights and fresh discussions about all things SEO.

    1. Home
    2. SEO Tactics
    3. How can I make a list of all URLs indexed by Google?

    Moz Q&A is closed.

    After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

    How can I make a list of all URLs indexed by Google?

    SEO Tactics
    redirect indexed urls google url index google broken links
    6
    7
    4524
    Loading More Posts
    • Oldest to Newest
    • Newest to Oldest
    • Most Votes
    Reply
    • Reply as question
    Log in to reply
    This topic has been deleted. Only users with question management privileges can see it.
    • aplusnetsolutions
      aplusnetsolutions Subscriber last edited by

      I have a large site with over 6000 pages indexed but only 600 actual pages and need to clean up with 301 redirects. Haven't had this need since Google stopped displaying the url's in the results.

      BlueprintMarketing SHIJOTACS 3 Replies Last reply Reply Quote 0
      • Kaushalwpandas
        Kaushalwpandas last edited by

        very depressed of being not indexing URL - https://www.wrightleatherworks.com/collections/gun-holsters-for-women please someone help

        1 Reply Last reply Reply Quote 0
        • Natalie305
          Natalie305 last edited by

          Open the sitemap in a text editor or XML viewer. Look at the <loc> tags in the sitemap file. These tags contain the URL of each page on the website. You can copy the URLs from the <loc> tags into a spreadsheet or text document.

          1 Reply Last reply Reply Quote 1
          • Luna204
            Luna204 last edited by

            Open the sitemap in a text editor or XML viewer. Look at the <loc> tags in the sitemap file. These tags contain the URL of each page on the website. You can copy the URLs from the <loc> tags into a spreadsheet or text document.

            1 Reply Last reply Reply Quote 0
            • SHIJOTACS
              SHIJOTACS @aplusnetsolutions last edited by

              @aplusnetsolutions create a seperate sitemap for not indexed pages and upload to google web master tools. i had a website had same issues. Also remember it will take some time also

              1 Reply Last reply Reply Quote 0
              • BlueprintMarketing
                BlueprintMarketing @aplusnetsolutions last edited by

                @aplusnetsolutions
                Make sure all these things are selected in screaming frog and crawl analysis selected

                1 Reply Last reply Reply Quote 1
                • BlueprintMarketing
                  BlueprintMarketing @aplusnetsolutions last edited by

                  @aplusnetsolutions

                  Going to Google search console it will tell you how many inches are inside Google search index there are a few other ways to do this if you want

                  #1
                  By far the easiest is to going to search console and select coverage and all known pages
                  alt text

                  number 2

                  For the quick and dirty method, simply perform a simple site search in your Google search bar with “site:yourdomain.com”

                  #3

                  You can crawl your site using screaming frog (it will 500 pages for free but every SEO should have it) use it to index your site and connect it to Google search console API as well as Google analytics and you will have a easy-to-read CSV export of your index and non-index pages
                  more on how this is done

                  ![ you can see the non-indexable URLs on the the right click that](77e61d47-2172-491c-8070-9a6cd5905fff-image.png image url)

                  video https://youtu.be/iYeXSdUt_hg

                  #4
                  or indexer site with any thing that can export a CSV download the CSV uploaded here and it will tell you which pages are in Google's index
                  https://www.rankwatch.com/free-tools/google-index-checker

                  https://searchengineland.com/check-urls-indexed-without-upsetting-google-follow-267472

                  https://seo.co/google-index/

                  1 Reply Last reply Reply Quote 0
                  • 1 / 1
                  • First post
                    Last post

                  Got a burning SEO question?

                  Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.


                  Start my free trial


                  Browse Questions

                  Explore more categories

                  • Moz Tools

                    Chat with the community about the Moz tools.

                  • SEO Tactics

                    Discuss the SEO process with fellow marketers

                  • Community

                    Discuss industry events, jobs, and news!

                  • Digital Marketing

                    Chat about tactics outside of SEO

                  • Research & Trends

                    Dive into research and trends in the search industry.

                  • Support

                    Connect on product support and feature requests.

                  • See all categories

                  Related Questions

                  • Sert_Sibiu

                    URL with .html or not

                    url with .html

                    Hello,
                    I have an online shop for printer consumables
                    Categories url's are like that https://www.sertit.ro/consumabile-imprimante.html
                    And products https://www.sertit.ro/cartuse-toner/xerox/cartus-toner-xerox-phaser-3020-workcentre-3025-1500-pagini.html
                    Is better to have .html or not?

                    SEO Tactics | | Sert_Sibiu
                    0
                  • sasansasyino

                    google webmaster tools Indexing request rejected

                    indexing request rejected webmaster indexing

                    when i try to index my posts in google webmaster tools i see this eror : Indexing request rejected
                    During live testing, indexing issues were detected with the URL
                    Crawl
                    Time
                    Sep 23, 2023, 11:05:05 PM
                    Crawled as
                    Google Inspection Tool desktop
                    Crawl allowed?
                    Yes
                    Page fetch
                    error
                    Failed: Hostload exceeded
                    Indexing allowed?
                    N/A
                    Indexing
                    User-declared canonical
                    N/A
                    Google-selected canonical
                    
                    Only determined after indexing my website : http://123select.ir/

                    SEO Tactics | | sasansasyino
                    0
                  • xShams

                    Unsolved Google is ranking me #1 singular but not plural

                    serps ranking issue

                    Hi all, I am facing an ranking issue, I am trying to rank on a query:
                    "Recruitment Agencies In Pakistan for Saudi Arabia" Google is ranking me correctly #1 in singular version on the query, but not in plural version. Even my competitors in SERP's are same and ranking correctly on both teams. And yes, the real/in-search keyword is ""Recruitment Agencies In Pakistan for Saudi Arabia" and not the "Recruitment Agency In Pakistan for Saudi Arabia" I have gone through my on-page and off page but sill can't find the solution. Here is the image of current SERP's: "Recruitment Agencies In Pakistan for Saudi Arabia"
                    1.jpg "Recruitment Agency In Pakistan for Saudi Arabia"
                    2.jpg Can anyone please guide me on this, like what should i do?

                    SEO Tactics | | xShams
                    0
                  • Leviiii

                    slug Link redirect to subdomain?

                    redirect subdomain link building

                    Hi !
                    Im Levi new here and new in the world of SEO, please dont judge if my questions are silly. Back on the days when the site was built we thought it is a good ideea to have subdomains that together with the domain name represent our main keywords.
                    ex. https://stansted.tonorwich.uk, https://heathrow.tonorwich.uk, https://luton.tonorwich.uk, https://gatwick.tonorwich.uk. There is content on this subdomains, would it make any difference from SEO perspective if we create slugs that redirect to these subdomains? for example creating https://tonorwich.uk/taxi-minibus-vip-tesla-norwich-to-stansted that redirects to https://stansted.tonorwich.uk ? Or better create these slugs with slightly different content?
                    Any ideeas would be appreciated.
                    Thanks in advance!

                    Link Building | | Leviiii
                    0
                  • Tunnel7

                    Unsolved Site showing up in Google search results for irrelevant keywords

                    serp keyword rankings

                    Hi there, one of my client's sites is showing up in Google search results / getting a lot of site traffic from keywords that while very close to words we're actually trying to target on the site, are irrelevant for the client and their site content. Does anyone have ideas of how to address this?

                    SEO Tactics | | Tunnel7
                    0
                  • BeKonstructive

                    Multiple URLs from One Domain on Page 1

                    multiple urls

                    Is it possible (and if it is possible, how difficult is it) to get multiple URLs from the same domain name to be indexed on the first page of Google for the same keyword or phrase? Assuming each URL has significantly different content of course... Context: A large real estate brand has 6 franchise offices in the same city. Each office has its own listing/landing page on the parent brand website. Each franchise owner wants their page on the website to rank for the term 'Christchurch real estate'. The homepage of the parent brand website currently ranks on the first page of Google for this search term, but none of the franchisee pages do. So my question is: with the right unique content on each franchisee page, supported by quality backlinks to each of the different offices, is it possible to get multiple franchisees listed on the first page of Google given that ultimately the 6 URLs are all attached to the same domain name? (And, if so, do you have any hot tips you can share to assist me on this uphill battle?)

                    SEO Tactics | | BeKonstructive
                    0
                  • Hasanovic

                    Google Not Indexing Pages (Wordpress)

                    google search console indexed urls indexation

                    Hello, recently I started noticing that google is not indexing our new pages or our new blog posts. We are simply getting a "Discovered - Currently Not Indexed" message on all new pages. When I click "Request Indexing" is takes a few days, but eventually it does get indexed and is on Google. This is very strange, as our website has been around since the late 90's and the quality of the new content is neither duplicate nor "low quality". We started noticing this happening around February. We also do not have many pages - maybe 500 maximum? I have looked at all the obvious answers (allowing for indexing, etc.), but just can't seem to pinpoint a reason why. Has anyone had this happen recently? It is getting very annoying having to manually go in and request indexing for every page and makes me think there may be some underlying issues with the website that should be fixed.

                    Technical SEO | | Hasanovic
                    1
                  • fJ66doneOIdDpj

                    Multilang site: Auto redirect 301 or 302?

                    redirect 301 redirect 302 international seo

                    We need to establish if 301 or 302 response code is to be used for our auto redirects based on Accept-Language header. https://domain.com
                    30x > https://domain.com/en
                    30x > https://domain.com/ru
                    30x > https://domain.com/de The site architecture is set up with proper inline HREFLANG.
                    We have read different opinions about this, Ahrefs says 302 is the correct one:
                    https://ahrefs.com/blog/301-vs-302-redirects/
                    302 redirect:
                    "You want to redirect users to the right version of the site for them (based on location/language)." You could argue that the root redirect is never permanent as it varies based on user language settings (302)
                    On the other hand, the lang specific redirects are permanent per language: IF Accept-Language header = en
                    https://domain.com > 301 > https://domain.com/en
                    IF Accept-Language header = ru
                    https://domain.com > 301 > https://domain.com/ru So each of these is 'permanent'. So which is the correct?

                    International SEO | | fJ66doneOIdDpj
                    0

                  Get started with Moz Pro!

                  Unlock the power of advanced SEO tools and data-driven insights.

                  Start my free trial
                  Products
                  • Moz Pro
                  • Moz Local
                  • Moz API
                  • Moz Data
                  • STAT
                  • Product Updates
                  Moz Solutions
                  • SMB Solutions
                  • Agency Solutions
                  • Enterprise Solutions
                  • Digital Marketers
                  Free SEO Tools
                  • Domain Authority Checker
                  • Link Explorer
                  • Keyword Explorer
                  • Competitive Research
                  • Brand Authority Checker
                  • Local Citation Checker
                  • MozBar Extension
                  • MozCast
                  Resources
                  • Blog
                  • SEO Learning Center
                  • Help Hub
                  • Beginner's Guide to SEO
                  • How-to Guides
                  • Moz Academy
                  • API Docs
                  About Moz
                  • About
                  • Team
                  • Careers
                  • Contact
                  Why Moz
                  • Case Studies
                  • Testimonials
                  Get Involved
                  • Become an Affiliate
                  • MozCon
                  • Webinars
                  • Practical Marketer Series
                  • MozPod
                  Connect with us

                  Contact the Help team

                  Join our newsletter
                  Moz logo
                  © 2021 - 2025 SEOMoz, Inc., a Ziff Davis company. All rights reserved. Moz is a registered trademark of SEOMoz, Inc.
                  • Accessibility
                  • Terms of Use
                  • Privacy

                  Looks like your connection to Moz was lost, please wait while we try to reconnect.