Why my site not crawl?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Could my Crawl Error Report be wrong?
HI there, I am using Yoast SEO plugin on a wordpress website. I am currently showing 70 Med priority crawl errors 'missing meta description' on my Moz pro account. This number of missing meta descriptions has increased over the last 6 weeks. But every single page / post / tag / category has both the title and meta description completed via Yoast. I requested a google bot to crawl the site a few weeks ago as thought it perhaps wasn't been crawled and updated. Any idea what the issue might be? Could the Moz report be incorrect for some reason? Or could something be blocking Moz / Google from seeing the Yoast plugin?
Moz Pro | | skehoe0 -
Not all pages are being crawled
I am set up on the PRO plan, I was under the impression that it would crawl up to 10,000 pages. My site has just over 200 pages, but whenever I am crawled it only crawls 121 pages. Is this normal? It's hard to know how reliable my data is because a significant amount of pages are missing.
Moz Pro | | KristinHarding0 -
When will be the 250 pages crawled limit eliminated?
Hi, I signed up yesterday for a SEOMoz Pro Account, and would like to know, please, when will be the 250 pages crawled limit eliminated? 🙂 Thanks in advance for your help!
Moz Pro | | Andarilho0 -
Link Diagnosis and Open Site Explorer
I work at a web design firm that's starting to offer SEO to its clients. They want to keep costs down until the SEO side becomes more established, so I've been using mostly free tools to do the SEO. I've been using a website called LinkDiagnosis.com to check backlinks for clients. It says the data is provided by SEOmoz, so I thought it must be pretty reliable. However, I just signed up for the PRO trial to test out all of SEOmoz's tools (& hopefully convince my company to sign us up), and I find that the link information between the 2 tools can be vastly different! Sometimes the number of unique linking domains is very close, but other times it can be off by hundreds, even thousands, with Open Site Explorer typically providing the higher numbers. Is the Link Diagnosis tool really powered with data from SEOmoz, or does it just receive a portion of the data, since it's a free tool? I'm just trying to figure out what will be the most reliable solution for me to keep using, and the discrepancies between the two tools has caused me to question the reliability of both. Thanks, Hector
Moz Pro | | hmunoz0 -
Crawl Diagnostic Errors
Hi there, Seeing a large number of errors in the SEOMOZ Pro crawl results. The 404 errors are for pages that look like this: http://www.example.com/2010/07/blogpost/http:%2F%2Fwww.example.com%2F2010%2F07%2Fblogpost%2F I know that t%2F represents the two slashes, but I'm not sure why these addresses are being crawled. The site is a wordpress site. Anyone seen anything like this?
Moz Pro | | rosstaylor0 -
What analysis exists for Out Bound Links (OBL) from your site
Hi Maybe I am missing this but I can''t seem to see it. I am doing some analysis on a client's site and want to get a csv list of links from the client's site to external sites. So what I am looking for is a list of Out Bound Links (OBL) from the client's site. I want to run these past a black list / bad link neighborhood checking script I have. This would actually be a nice feature in SEO Moz Pro, unless it actually already does and I am just missing it or not setting filters correctly. Thanks Trevor
Moz Pro | | tstolber10 -
When does Open Site Explorer automatically follow a redirect?
Does anyone know what determines when Open Site Explorer will ask if you meant to type in the redirected URL or when it will automatically change the URL to the www version. example of a site I get asked the redirect question: http://www.opensiteexplorer.org/comparisons.html?site=checkbook.org Oh Hey! It looks like that URL redirects to www.checkbook.org/. Would you like to see data for <a class="clickable redirects">that URL instead</a>? example of a site that redirects automatically: http://www.opensiteexplorer.org/comparisons.html?site=healthleap.com
Moz Pro | | irvingw1 -
Potential site architecture problem.
We are experiencing a problem in which category pages do not appear to be passing Page Authority to subcategory pages. See the example below: Home page has PA of 47 http://www.minespress.com/ The next level category page down has a PA of 34 http://www.minespress.com/category/apparel The next sub category down has PA of 1, and shows no links at all in spite of the fact that we got to it from a category link http://www.minespress.com/category/golf-shirts The page in question is crawlable, is indexed and has nothing that we can see that would be prevent it from showing Page Authority and a link profile using your tools. Do we have a site architecture problem?
Moz Pro | | smines0