Moz crawl only shows 2 pages, but we have more than 1000 pages.
-
Hi Guys
Is there anyway we can test Moz crawler ? it showing only 2 pages crawls. We are running website on HTTPS ? Is HTTPS is issues for Moz ?
-
Awesome, glad to hear it's working for you
-
Cool, it seem to be picked up now. Not sure what was wrong.
-
Thank you!
So I took a look at your campaigns and it shows we crawled 394 pages.
http://www.screencast.com/t/bQcauoHeH27B
It's possible that your first crawl may not have picked up on the redirect but it's definitely finding pages now.
Let me know if you see something different in your settings.
Cheers,
-
-
Hello!
Is there a specific campaign you are referring to? I would love to take a look and see if I can help.
Cheers,
-
Thanks mate
I can do crawl using http://pro.moz.com/tools/crawl-test
But scheduled one is not picking up anything.
-
I don't think Moz yet crawls https.
Megan's answer here should help: http://moz.com/community/q/does-seomoz-work-for-fully-secure-sites-https
Later, Chiaryn said "March" but I don't know if it's here yet: http://moz.com/community/q/https-on-ose
On the help forum, Adam said "when we release this feature" in April ... https://seomoz.zendesk.com/entries/20770156-open-site-explorer-to-crawl-https
You can test the crawl here: http://pro.moz.com/tools/crawl-test
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
Abnormal crawl issues appearing in my Moz results
I have been asked to look at a site for a friend and was more than surprised to see 16,9k crawl issues appear in the dashboard... of this 6,238 are duplicate page content and 5878 are duplicated page titles. What on earth is going on? I have spoken to the web developer as it appears there is a dev site somewhere and this is his response [Can I stress that Google determines which site was in the index first and then removes other sites it sees as having duplicate content. Our dev sites appearing in the search index would not affect your ranking due to duplicate content as Google would see your site as the first site with the content] As I cannot make contact with him, I am scratching my head, surely a dev site should be no-indexed, it sounds as though he is saying that its ok because Google will take the main site as the first site with the content... Very confused! Help need MOZ community. Manythanks, Sarah
Moz Pro | | Mutatio_Digital0 -
Spam Score shows No Contact Info even though I have a Contact Page
Hello, Open Site Explorer give me a Spam Flag for No Contact Info, but I have a Contact page (http://www.localwisejobs.com/contact/) Google has indexed my contact page. So that's not the problem. Any idea why I'm seeing this flag? Thanks!
Moz Pro | | mztobias1 -
2 canonical links on 1 page, 1 for print version
Our developer has added a 2nd canonoical link for the "print" version of our page. I read on another post that this appears to be not be the correct way to do this. Is there a better way ? Here is an example of the code:
Moz Pro | | foodsleuth0 -
Not provided traffic in Moz
Hello, I was wondering, if anyone knew how moz handles non provided keywords? is it not displayed, or is it labeled as something else? I know in WMT, it still displays it. Thanks for your help.
Moz Pro | | PeterRota1 -
Functionality of SEOmoz crawl page reports
I am trying to find a way to ask SEOmoz staff to answer this question because I think it is a functionality question so I checked SEOmoz pro resources. I also have had no responses in the Forum too it either. So here it is again. Thanks much for your consideration! Is it possible to configure the SEOMoz Rogerbot error-finding bot (that make the crawl diagnostic reports) to obey the instructions in the individual page headers and http://client.com/robots.txt file? For example, there is a page at http://truthbook.com/quotes/index.cfm month=5&day=14&year=2007 that has – in the header -
Moz Pro | | jimmyzig
<meta name="robots" content="noindex"> </meta name="robots" content="noindex"> This page is themed Quote of the Day page and is duplicated twice intentionally at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2004 and also at http://truthbook.com/quotes/index.cfm?month=5&day=14&year=2010 but they all have <meta name="robots" content="noindex"> in them. So Google should not see them as duplicates right. Google does not in Webmaster Tools.</meta name="robots" content="noindex"> So it should not be counted 3 times? But it seems to be? How do we gen a report of the actual pages shown in the report as dups so we can check? We do not believe Google sees it as a duplicate page but Roger appears too. Similarly, one can use http://truthbook.com/contemplative_prayer/ , here also the http://truthbook.com/robots.txt tells Google to stay clear. Yet we are showing thousands of dup. page content errors when Google Webmaster tools as shown only a few hundred configured as described. Anyone? Jim0 -
2 SEO questions
Hello everyone 🙂 I have two questions for all you fine seo people this morning... 1 - Is there a website that I could go to to make sure that I do not have duplicate content floating around on the web that I am not aware of? Sometimes people take information from my site and post it as their own and I want to make sure that google does not ping me for it. 2 - Does anyone know how I can report a spam site to google? I have filled out the reports many times over the past year and posted it in the webmaster discussion forum and it is still up there 🙂 I sent one email to bing and the next day they contacted me with a thank you email and indicated that I was 100% correct and they removed the site from their index. Thank you all!!!!
Moz Pro | | nazmiyal0 -
Too Many On-Page Links: Crawl Diag vs On-Page
I've got a site I'm optimizing that has thousands of 'too many links on-page' warnings from the SeoMoz crawl diagnostic. I've been in there and realized that there are indeed, the rent is too damned high, and it's due to a header/left/footer category menu that's repeating itself. So I changed these links to NoFollow, cutting my total links by about 50 per page. I was too impatient to wait for a new crawl, so I used the On Page Reports to see if anything would come up on the Internal Link Count/External Link Count factors, and nothing did. However, the crawl (eventually) came back with the same warning. I looked at the link Count in the crawl details, and realized that it's basically counting every single '<a href'="" on="" the="" page.="" because="" of="" this,="" i="" guess="" my="" questions="" are="" twofold:<="" p=""></a> <a href'="" on="" the="" page.="" because="" of="" this,="" i="" guess="" my="" questions="" are="" twofold:<="" p="">1. Is no-follow a valid strategy to reduce link count for a page? (Obviously not for SeoMoz crawler, but for Google)</a> <a href'="" on="" the="" page.="" because="" of="" this,="" i="" guess="" my="" questions="" are="" twofold:<="" p="">2. What metric does the On-Page Report use to determine if there are too many Internal/External links? Apologies if this has been asked, the search didn't seem to come up with anything specific to this.</a>
Moz Pro | | icecarats0