MOZ Crawl help
-
Our MOZ report says it crawled 1800 pages so it reports a lot of errors based on those pages. We don't have that many pages on our site. What is MOZ crawling? I updated the profile to make sure it crawls the filtered page section of Google Analytics.
-
Hey Jessica,
I took a look at your crawl diagnostics and there isn't anything that looks too out of the ordinary. You have 415 duplicate pages, which is over inflating your page count.
Additionally, when I exported your crawl diagnostics CSV I saw a mixture of static URLs and Dynamic URLs. This may mean that you have two coppies of each page being crawled, which could be leading to over inflated page totals. You might want to look at your CMS and make sure that it is not making 2 copies of each page.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Jessica,
Well that's a pretty good mix
Having a bunch of different kinds of errors like that could be due to a combination of issues, but I would think that first of all you have a duplicate content issue either because your cms is creating it through different urls for things like multiple categories, archive pages and that kind of thing or because you have a server setup issue that is allowing access to the same pages through multiple urls (like www vs non www urls). It might well be a combination of these things accounting for different errors so you are going to need to narrow down the data to find out exactly what is going on.
Download your error report in csv, open it in excel and select all and then do ctrl-windows-L combination. This will put your data into a filterable table. You can then go to the headers and filter (for example) only 404 pages or only duplicate title pages. Once you have filtered for a specific error have a look at the left hand column for which page or pages the problem is appearing on and then the far right hand column to see which page is linking to this page or pages. You will then have a better idea where the problem is and how it is being reached by the crawler and that will guide you on where to look to fix it. If you want to give a couple of example urls a few obvious things might stand out.
Hope that helps!
-
By filtered, I meant that we have a profile that filters out employees hitting the site. Sorry, shouldn't have mentioned it because it isn't relevant.
-
Hi Lynn,
Thank you for getting back to me. Here is an image of our diagnostics with the errors.
-
Hi Jessica,
What are the errors telling you? If it is a lot of duplicate content type errors it could be an indication that your site is linking to the same pages in multiple ways. So even though you think your site has xx number of pages, to the crawler (and search engines) it actually has more! Not sure what you mean in regards updating the profile to crawl filtered section of google analytics? If you care to give us an example of the errors and your site we might be able to give more details.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved MOZ Crawler Stalled
MOZ crawl has been waiting since April 2nd. Whats the deal? I am not able to "recrawl", so i have been stuck in limbo.
Product Support | | WebMarkets0 -
Unsolved Performance Metrics crawl error
I am getting an error:
Product Support | | bhsiao 0
Crawl Error for mobile & desktop page crawl - The page returned a 4xx; Lighthouse could not analyze this page.
I have Lighthouse whitelisted, is there any other site I need to whitelist? Anything else I need to do in Cloudflare or Datadome to allow this tool to work?1 -
Hi please help me process the refund. The money that was charge is for my mom's heart operation.
How do we process the refund for an account that has never been used. Please please help us.
Product Support | | Dugard-Property0 -
Why does Moz see short Russian & Chinese urls as too long
We are translating content into Russian and Chinese on our website, the number of errors are increasing mainly around URL too long, each time we create a page with a Chinese or Russian url. If you click on the link below for a Chinese content page: https://www.westbourneschool.com/zh-hans/%E5%AE%BF%E8%88%8D%E5%8F%8A%E5%AF%84%E5%AE%BF%E5%AE%B6%E5%BA%AD/%E5%AE%BF%E8%88%8D%E7%94%9F%E6%B4%BB You will notice the url displayed by the browser is actually not very long, is there a way for MOZ not to see it as it appears above? Below is a page in Russian https://www.westbourneschool.com/ru/%D0%A8%D0%BA%D0%BE%D0%BB%D0%B0%20%D0%9F%D1%80%D0%BE%D0%B6%D0%B8%D0%B2%D0%B0%D0%BD%D0%B8%D0%B5 Any help will be much appreciated.
Product Support | | mariedetitomount0 -
Cannot Access Moz Analytics
I've been trying to access Moz Analytics for over a month but have continued to see this error message: http://screencast.com/t/GMnN6l9WEI tried on all browsers and cleared my cache. The login works, because I am able to access it on other computers but not on my primary computer. This leads me to believe that Moz' servers are blocking out my computer's IP address for whatever reason.I've tried emailing the help team and calling but have not gotten any sort of response so far. Anyone have a solution?
Product Support | | EvolveDigitalLabs1 -
Is Moz creating a Bunker-Mentality with its Customers?
I’ve been using Moz (and SEOMoz) for almost 3 years. During that time, I’ve found them to be very engaged; however, during the last several months, I’ve found a shift in this philosophy—which is a bit disheartening: SEOMoz used to have a very simple contact-us page that listed an email to the help desk as well as the office. Now, they have the locations of the two Moz offices, with no phone numbers or emails. Moz’s help hub, used to have a form that could be completed when you were having issues. Now, there is only a list of community-managed resources to access. The only way you can find the way to contact their help desk is if something breaks & the website gives you an email help@moz.com. However, this email account seems to get overloaded quite often and you will get a “Delivery Response Failed” message because their inbox is full. Does anyone know how to get a hold of Moz directly? I'm having some issues accessing Moz Analytics and really need help from their support team.
Product Support | | TopFloor4 -
Why Moz Analytics says that my site had a 13% traffic increase and Moz Pro says that the same site had 3% decrease on traffic?
Every Tuesday The first thing I do in the morning is check my updates on my Moz Campaigns... Today the numbers just don't make sense... How come Moz Analytics and Moz Pro are showing different numbers? Does any one have the same problem? Which one should i trust?
Product Support | | Felip30 -
Where is the Moz Pro free trial?
Since SEOmoz become Moz, I can't find the Moz Pro free trial registration page. Anyone?
Product Support | | Elchanan0