Is there a report I can run to get a list of all pages indexed by Google for my website?
-
I want to get a CSV file of all the pages that are indexed by Google and other search engines so I can create and .htaccess file of 301 redirects
-
If you only want your indexed pages, you can add the SeoQuake plugin to your browser than do a google search like site:http://www.yoursite.com/ . Be sure to chose "show with omitted results included". This search will show all the indexed pages of your site. From Google settings, chose 50 or 100 results per page and than, above the results, SeoQuake has an option to download as CSV.
Assuming that you don't have thousands of pages, save them from each Google results page and get them together in one file. Than, you can sort them out and do whatever you want to. Good luck!
-
Sorry, what I actually need is a list of the pages in my website that Google has already indexed.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you suggest a good website for a roofing contractor??
I have a roofing contractor friend that wants a new site. There's a lot of choices out there, so to save a little time I'm looking for good suggestions. Ideally one with a good DA, and the ability to make manual edits on the back side. Thanks in advance:)
Moz Pro | | MissThumann0 -
My home page has an "A" rank in Moz and not ranking in Google.
My home page recently dropped from page one in Google to not being ranked for my top keyword. The page has an "A" ranking in MOZ for the keyword. Is there a way to find out the cause. I did have what looked like a duplicate page for a while 3 months ago when a domain was forwarding to my home page incorrectly. Appeared with second domain name instead of primary. Our business has been 95% through internet leads so quite an issue. Is there anyway to find out what is going on.
Moz Pro | | FredRoven0 -
How do I disallow a subdirectory in my reports?
My seomoz reports include thousands of pages from a "localmarket" subdirectory licensed to an ad packager that I am soon turning off. How do I remove this subdirectory from seomoz reports now?
Moz Pro | | mulligan0 -
Domain.com and domain.com/index.html duplicate content in reports even with rewrite on
I have a site that was recently hit by the Google penguin update and dropped a page back. When running the site through seomoz tools, I keep getting duplicate content in the reports for domain.com and domain.com/index.html, even though I have a 301 rewrite condition. When I test the site, domain.com/index.html redirects to domain.com for all directories and root. I don't understand how my index page can still get flagged as duplicate content. I also have a redirect from domain.com to www.domain.com. Is there anything else I need to do or add to my htaccess file? Appreciate any clarification on this.
Moz Pro | | anthonytjm0 -
Too many on-page links
one of my SEOmoz pro campaigns has given me the warning: Too many on-page links and the page in question is my html sitemap. How do i resolve this because I obviously need my sitemap. How do i get around this?
Moz Pro | | CompleteOffice1 -
Crawl Diagnostics Report
I'm a bit concerned about the results I'm getting from the Crawl Diagnostics Report. I've updated the site with canonical urls to remove duplicate content and when I check the site - it all displays the right values, but the report, which has just finished crawling is still showing a lot of pages as duplicate content. Simple example: http://www.domain.com http://www.domain.com/ Both of them are in the duplicate content section although both have canonical url set as: Does each crawl check the entire site from the beginning or just the pages it didn't have a chance to crawl the last time? This is just one of 333 duplicate content pages, which have canonical url pointing to the right page. Can someone please explain?
Moz Pro | | coremediadesign0 -
Only 1 page has been crawled. Why?
I set a new profile up a fortnight ago. Last week seomoz crawled the entire site (10k pages), and this week has only crawled 1 page. Nothing's changed on the site that I'm aware of, so what's happened?
Moz Pro | | tompollard0 -
Company Name in Page Title creating thousands of "Duplicate Page Title" errors
I am new, and I just got back my crawl results (after a week or more). The first thing I noticed is that the "duplicate page title" is in the thousands, my urls and page titles are different. The only thing I can see is that our company name is at appended to the name of every title. I did search and found one other person with this problem, but no answer was given. Can anyone offer some advice? This doesn't seem right... Thanks,
Moz Pro | | AoyamaJPN0