Moz crawl only shows 2 pages, but we have more than 1000 pages.
-
Hi Guys
Is there anyway we can test Moz crawler ? it showing only 2 pages crawls. We are running website on HTTPS ? Is HTTPS is issues for Moz ?
-
Awesome, glad to hear it's working for you
-
Cool, it seem to be picked up now. Not sure what was wrong.
-
Thank you!
So I took a look at your campaigns and it shows we crawled 394 pages.
http://www.screencast.com/t/bQcauoHeH27B
It's possible that your first crawl may not have picked up on the redirect but it's definitely finding pages now.
Let me know if you see something different in your settings.
Cheers,
-
-
Hello!
Is there a specific campaign you are referring to? I would love to take a look and see if I can help.
Cheers,
-
Thanks mate
I can do crawl using http://pro.moz.com/tools/crawl-test
But scheduled one is not picking up anything.
-
I don't think Moz yet crawls https.
Megan's answer here should help: http://moz.com/community/q/does-seomoz-work-for-fully-secure-sites-https
Later, Chiaryn said "March" but I don't know if it's here yet: http://moz.com/community/q/https-on-ose
On the help forum, Adam said "when we release this feature" in April ... https://seomoz.zendesk.com/entries/20770156-open-site-explorer-to-crawl-https
You can test the crawl here: http://pro.moz.com/tools/crawl-test
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
WEbsite cannot be crawled
I have received the following message from MOZ on a few of our websites now Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster. I have spoken with our webmaster and they have advised the below: The Robots.txt file is definitely there on all pages and Google is able to crawl for these files. Moz however is having some difficulty with finding the files when there is a particular redirect in place. For example, the page currently redirects from threecounties.co.uk/ to https://www.threecounties.co.uk/ and when this happens, the Moz crawler cannot find the robots.txt on the first URL and this generates the reports you have been receiving. From what I understand, this is a flaw with the Moz software and not something that we could fix form our end. _Going forward, something we could do is remove these rewrite rules to www., but these are useful redirects and removing them would likely have SEO implications. _ Has anyone else had this issue and is there anything we can do to rectify, or should we leave as is?
Moz Pro | | threecounties0 -
Why does Moz show 302s that I previously resolved?
So Moz was flagging thousands of 302 errors in the Redirect Issues section. It was due to the URL extensions containing /directory/currency/switch/currency/ I added this to my Robots.txt file as I don't want these indexed. I marked the 302 errors as fixed and after the next crawl they came back and I now get the message: One or more previously fixed issues continue to persist. We have found one or more issues that were marked as fixed previously in the last crawl. Do I just ignore the errors or is there something wrong that I may be doing? Any help would be much appreciated. Thank you.
Moz Pro | | lbagley0 -
Web Stie STUCK on page 2 for 2years
Our website is a dating site for adults (not porn) (http://www.swingersocial.com) It’s been STUCK in the middle of page 2 for 1 ½ years. Moving up or down 2 ranking, that’s it. The way we determine our location is by entering the most common phrases used by people who search for our type of site. We surveyed 50+ people and the phrases they most frequently entered when using Google were “swingers websites” “swingers sites” and “free swingers sites”. In addition to our competitors ranking above us, they show “movement” in their rankings up & or down. Some even dropped to page 2 but they recovered – we are not seeing the same movement or recovery. Pages crawled on have remained virtually unchanged for months. The last 1 ½ years we have hired SEO companies, and as a result a great deal of effort has been put into the site. We are not naïve and realize some were better than others. We’ve invested a great deal of effort into content, key words, modifying tags, and throughout all of this we’ve seen no change. We had a detailed audit suggesting improvements (no surprise), the report overall was positive stating “There are a few things to do to optimize the site but looking at the keywords, SwingerSocial.com should be able to rank high.” We also implemented a blog area with over 70 blog posts. Our competitors on the other hand have only two blog posts and are continually ranking higher than us. Additionally, our competitors do not have sites on Pinterest, G+, FB, or Twitter – we have a presence on some of these. I do know that the number and quality of links are terrible. I’m looking for a partner to help us make strategic changes to the site that will allow us to rank higher.
Moz Pro | | sailor35700 -
Having 1 page crawl error on 2 sites
Help! A few weeks back, my dev team did some "changes" (that I don't know anything about), but ever since then, my Moz crawl has only shown one page for either http://betamerica.com or http://fanex.com. Moz service was helpful in talking about a redirect loop that existed, and I asked my team to fix it, which it looks to me like they have. Still, 1 page. I used SEO Book's spider tool and it also only sees 1 page, and sees the sites as http://https://betamerica.com (for example), which is just weird. I don't know enough about HT Access or server stuff to figure out what's going on, so if someone can help me figure that out, I'd appreciate it.
Moz Pro | | BetAmerica0 -
SEO on-demand crawl
what happened to the on-demand crawl you could do in PRO when they switched to the new MOZ site?
Moz Pro | | Vertz-Marketing0 -
Crawl diagnostics incorrectly reporting duplicate page titles
Hi guys, I have a question in regards to the duplicate page titles being reported in my crawl diagnostics. It appears that the URL parameter "?ctm" is causing the crawler to think that duplicate pages exist. In GWT, we've specified to use the representative URL when that parameter is used. It appears to be working, since when I search site:http://www.causes.com/about?ctm=home, I am served a single search result for www.causes.com/about. That begs the question, why is the SEOMoz crawler saying there is duplicate page titles when Google isn't (doesn't appear under the HTML improvements for duplicate page titles)? A canonical URL is not used for this page so I'm assuming that may be one reason why. The only other thing I can think of is that Google's crawler is simply "smarter" than the Moz crawler (no offense, you guys put out an awesome product!). Any help is greatly appreciated and I'm looking forward to being an active participant in the Q&A community! Cheers, Brad
Moz Pro | | brad_dubs0 -
Only few pages (308 pages of 1000 something pages) have been crawled and diagnosed in 4 days, how many days till the entire website is crawled complete?
Setup campaign about 4-5 days ago and yesterday rogerbot said 308 pages were crawled and the diagnostics were provided. This website has over 1000+ pages and would like to know how long it would take for roger to crawl the entire website and provide diagnostics. Thanks!
Moz Pro | | TejaswiNaidu0 -
SEomoz slow to crawl?
Hello - I am just trying out the trial and it said the next crawl was nov 1st but I see no change in any of the errors since the initial crawl... so just waiting to find out if what I changed was fixed or not. Is this normal ?
Moz Pro | | Bethany_BabyBrowns0