Moz crawls
-
Hi all! I'm running two separate campaign crawls at the moment that I'm having a few issues with. The first is http://www.muchbetteradventures.com/.
I'm tracking this at root to try an pick any problems with a previous version of the site, which is on the v1.muchbetteradventures subdomain. However, I'm only seeing 100 or so pages as being crawled in Moz, compared to thousands in Google. There's no access blocked alerts in Moz either.
The second is http://www.sothebys.com/. I started this crawl at root a few days ago and no pages at all have been processed. Very odd!
Any advice would be much appreciated.
-
Thanks Reuben! Just getting my head around Screaming Frog! Can it be used to flag up duplicate content issues like Moz?
-
Hello and great question! If you are ever missing pages from your crawl, you can always email help@moz.com with the name of the campaign and a couple examples of missing pages. We can usually diagnose this issue pretty quickly. In a lot of cases, this could be due to the way some domains are forwarded or redirected. I encourage you to email us the issue with a few examples so that the Help Team, including myself, can dig in and figure out whats going on. Sorry for the delay, I hope we can help get to the bottom of your crawl issues.
-
1. Google's index may or may not be reflective of the pages you actually have on your site—likely the latter, hence the difference between the pages on your site and the pages in Google's index. Right now, the v1 subdomain times out, so no crawlers will be able to do anything with it. The www domain only has about 250 or so URLs.
2. Sotheby's website blocks all but a few crawlers, which is why Moz would not crawl any pages. http://www.sothebys.com/robots.txt
I would suggest using your own crawling software to untangle these issues. If you aren't familiar with Screaming Frog, you should check it out.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz is not showing difficulty and Priority from last day. can any body help?
i was just trying to check a keyword difficulty but when i put my kw the difficulty and priority is showing like this ( - ). can any one help? thanks
Product Support | | ayybeedee1 -
I have a client who wants to have their own Moz login. I want to move them out on to a new plan from the Standard (5 campaigns) plan. Can I do this?
For years I've been managing campaigns in Moz through Moz Pro. This enables up to 5 campaigns. One of my clients wants access to their campaign and are happy to pay for a new Moz Standard account just for them. My question is - can this be done? They would like my company (or more specifically me) to still have admin access to the account. I'm confused as to whether multi-seat is the right way to go? I don't want my client to login to my current Moz Pro account as I have other client's campaigns on it. Can anyone help as to the best approach.
Product Support | | T_Cooper0 -
Can i Have multiple Users on Moz. I want to give access to someone.
I want to provide an employee access to moz. Sharing my personal login and password is always risky. is there another way?
Product Support | | prestigeluxuryrentals.com1 -
I am unable to access my campaigns. Is anyone else having trouble connecting to http://analytics.moz.com/?
I am unable to access my campaigns. Is anyone else having trouble connecting to http://analytics.moz.com/?
Product Support | | jleite0 -
Moz Billing chat
How do I access billing chat, your page says there is one http://moz.com/help/pro/phone-support but it is difficult to find. This is urgent.
Product Support | | Thommas0 -
Moz Analytics Reports Scheduling
Hi, We have been using Moz now for a few weeks now and we are trying to run reports based on various time frames and can't seem to do so? For example on the if we needed a report from say 17/04/2014- 30/04/2014 how would we achieve this? Or if we wanted to schedule reports based on a calendar month- how do we achieve this? I tried running reports on the 1/05/2014 and received reports for Apr 25 - May 2, 2014. Also on the DASHBAORD- the timeframe only appears to display 'WEEKLY' and the last week of the month- 23th April- 30- Apr. Or will this change once we have more historical data compiled? Thanks,
Product Support | | Faxem0 -
Can't add "Custom links" in my Moz Profile
Hi, I was trying to add a custom link to my profile but I got an error message: "There was a problem saving your custom URLs" Can somebody look into it for me? Kind Regards
Product Support | | Laurensvda0 -
Email address for moz.com?
I signed up for a trial on seomoz and today i found out moz.com has charged me for a subscription without my knowledge. how can I contact them?
Product Support | | iareef0