Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Is there a easy way to see what pages are crawled?

Moz Pro

826

MattDG last edited by

Hello!

Like the questions says... Is there a easy way to see what pages are crawled? I don't mean the ones that have issues, but just the ones that have been crawled?

Regards,
1 Reply Last reply
Reply Quote 0
MattDG last edited by

Thanks! I was just wondering how it would be here in SEOMoz, Matt already helped me!
1 Reply Last reply
Reply Quote 0
Horizon last edited by

Hi Matt,

In your Crawl Diagnostics area, download the full CSV file. This will contain all of the pages on your site that have been crawled. You can filter out pages that do not have errors, should you need to.

Best,

Matt
1 Reply Last reply
Reply Quote 4

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Duplicate Page

I just Check Crawl the status error with Duplicate Page Content. As Mentioned Below. Songs.pk | Download free mp3, Hindi Music, Indian Mp3 Songs http://www.getmp3songspk.com Songs.pk | Download free mp3, Hindi Music, Indian Mp3 Songs http://getmp3songspk.com and then i added these lines to my htaccess file RewriteBase /
RewriteCond %{HTTP_HOST} !^www.getmp3songspk.com$ [NC]
RewriteRule ^(.*)$ http://www.getmp3songspk.com/$1 [L,R=301] But Still See that error again when i crawl a new test.
Moz Pro | | Getmp3songspk

0
Site Crawl Error

In moz crawling error this message is appears: MOST COMMON ISSUES 1Search Engine Blocked by robots.txt Error Code 612: Error response for robots.txt i asked help staff but they crawled again and nothing changed. there's only robots.XML (not TXT) in root of my webpage it contains: User-agent: *
Allow: /
Allow: /sitemap.htm anyone please help me? thank you
Moz Pro | | nopsts

0
Listing of all Google Indexed Pages

I started managing a site that has about 391,000 indexed pages. I want to get to the bottom of why there are so many in preparation for a ecommerce Migration and improving SEO. Anyone know of a tool? Many tools I have came across can only take 100 at a time. I would love to get them in excel or a database. I look forward to the suggestions.
Moz Pro | | dhands17

0
How long will it take for Page Rank (or Page Authority) to flow via a 301 redirect?

I've recently redeveloped a static site using WordPress and have created 301 redirects for the original urls to the new urls. I know I won't get all the value passed via the 301, but I'm hoping some will. Any idea how long this may take? It's been nearly a month since the changeover so wondering if it would be weeks, months or more?
Moz Pro | | annomd

0
How does moztrust compare with google page rank?

I have a trial Seomoz membership. I've been comparing my site to some of the competitor websites and Im confused about the moztrust vs google page rank. For instance some of my competitors have higher moztrust but my site has a higher google page rank. Isn't moztrust meant to duplicate google pagerank?? Why would these vary so much?
Moz Pro | | blac6789

0
Only 1 page is being crawled by SEOmoz for the last 2 crawls

I would like to ask for the possible problem plus solution on one of our campaigns. Only 1 page is being crawled by SEOmoz for the last 2 crawls. Before the last two crawls, SEOmoz crawls numerous pages and we can’t think of a possible reason for this error. For this particular campaign , there are no data --- no errors, warnings and notices. Thanks!
Moz Pro | | TheNorthernOffice79

0
How do you get Mozbot to crawl your website

I trying to get the mozbot to crawl my site so I can get new crawl diagnostics info. Anyone know how this can be done?
Moz Pro | | Romancing

0
What the . . ! Duplicate Pages and Titles WAY up?

My duplicate pages went up 50 plus in the past week, and my duplicate page titles went over more then 100. We recently redesigned the website, but it has been up for several weeks now. The only change I made specifically last week or late the week before was to get my 301 redirects done to get the www. version and the non www version pointing to the same place (as well as a couple other sites that point to it). I'm sure this is not enough info to figure out what went wrong . . . I'd love some help in figuring this out though.
Moz Pro | | damon1212

0