Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Site Redesign Launch - How Can I crawl for immediate review

Moz Pro

673

creativemobseo last edited by

Just redesigned my site and want to have a crawl done to check for errors or any items which need to be cleaned up. Anyone know how I can do this as SEOMoz only crawls once per week.

Thanks!
1 Reply Last reply
Reply Quote 0
KeriMorgret last edited by

You can crawl up to 3,000 URLs per subdomain via our crawl test at http://pro.seomoz.org/tools/crawl-test, which should help you out some.
1 Reply Last reply
Reply Quote 0
mjmorse last edited by

Screaming Frog Spider SEO is really good but the free version times out after 500 URLs.
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

When I did my first crawl, I was given some errors.

Do I then need to re-crawl to make sure the errors were fixed accordingly?
Moz Pro | | immortalgamer

0
Why does Crawl Diagnostics report this as duplicate content?

Hi guys, we've been addressing a duplicate content problem on our site over the past few weeks. Lately, we've implemented rel canonical tags in various parts of our ecommerce store, over time, and observing the effects by both tracking changes in SEOMoz and Websmater tools. Although our duplicate content errors are definitely decreasing, I can't help but wonder why some URLs are still being flagged with duplicate content by our SEOmoz crawler. Here's an example, taken directly from our Crawl Diagnostics Report: URL with 4 Duplicate Content errors:
/safety-lights.html Duplicate content URLs:
/safety-lights.html ?cat=78&price=-100
/safety-lights.html?cat=78&dir=desc&order=position /safety-lights.html?cat=78 /safety-lights.html?manufacturer=514 What I don't understand, is all of the URLS with URL parameters have a rel canonical tag pointing to the 'real' URL
/safety-lights.html So why is SEOMoz crawler still flagging this as duplicate content?
Moz Pro | | yacpro13

0
How to push negative product review sites down.

Hi Guys, One of my respected clients have some issues with negative product review sites coming up when they search their brand name on google. So for an exmaple, when I search for Company Name on google, the 3rd and 4th results are angry customer reviews. This is harming my clients brand so bad. My questions are, 1. What should I do to push these results down. I am happy to do pretty much ANYTHING to push these sites down. 2. I'm also thinking of doing a blog for this client for SEO purposes and wondering the pros and cons of having the blog as a subdomain vs subfolder. Which will help me to again, push the negative site links down. Thanks
Moz Pro | | Uds

0
Can I set Up Multiple Campaigns For Same Website?

I would like to set up one campaign for my main site example.com and another campaign for example.com/blog. Is it possible? I don't want crawling to overlap for these two separate campaigns.
Moz Pro | | jombay

0
Crawl Diagnostics Report

I'm a bit concerned about the results I'm getting from the Crawl Diagnostics Report. I've updated the site with canonical urls to remove duplicate content and when I check the site - it all displays the right values, but the report, which has just finished crawling is still showing a lot of pages as duplicate content. Simple example: http://www.domain.com http://www.domain.com/ Both of them are in the duplicate content section although both have canonical url set as: Does each crawl check the entire site from the beginning or just the pages it didn't have a chance to crawl the last time? This is just one of 333 duplicate content pages, which have canonical url pointing to the right page. Can someone please explain?
Moz Pro | | coremediadesign

0
Site explore reporting error over week

unable to dispaly anchor text error Doh! Roger is still working out the kinks with the new index and is having issues untangling anchor text data. We're currently showing anchor text data from the previous index, but we will update as soon as we can.
Moz Pro | | 1step2heaven12

0
Can anyone edit their comments?

I've been unable to edit my comments here for about a week 😕 Just me or is it like this for everyone? Tried FF 4, Chrome, IE 9, Safari and iPhone Safari. Just get the loading icon. If it's just me I'll submit a bug report.
Moz Pro | | StalkerB

0
Can you help me get started using the crawl diagnostics report?

After getting the crawl diagnostics report for the first time my boss and I looked over it and we have tried to fix the problems but we are stumped.I have tried and watched videos , read books, etc.. but have found nothing to help. I need assistance getting started on improving my website. Can you help?
Moz Pro | | WVInjuryLawyer

0