MOZ Crawl help
-
Our MOZ report says it crawled 1800 pages so it reports a lot of errors based on those pages. We don't have that many pages on our site. What is MOZ crawling? I updated the profile to make sure it crawls the filtered page section of Google Analytics.
-
Hey Jessica,
I took a look at your crawl diagnostics and there isn't anything that looks too out of the ordinary. You have 415 duplicate pages, which is over inflating your page count.
Additionally, when I exported your crawl diagnostics CSV I saw a mixture of static URLs and Dynamic URLs. This may mean that you have two coppies of each page being crawled, which could be leading to over inflated page totals. You might want to look at your CMS and make sure that it is not making 2 copies of each page.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Jessica,
Well that's a pretty good mix
Having a bunch of different kinds of errors like that could be due to a combination of issues, but I would think that first of all you have a duplicate content issue either because your cms is creating it through different urls for things like multiple categories, archive pages and that kind of thing or because you have a server setup issue that is allowing access to the same pages through multiple urls (like www vs non www urls). It might well be a combination of these things accounting for different errors so you are going to need to narrow down the data to find out exactly what is going on.
Download your error report in csv, open it in excel and select all and then do ctrl-windows-L combination. This will put your data into a filterable table. You can then go to the headers and filter (for example) only 404 pages or only duplicate title pages. Once you have filtered for a specific error have a look at the left hand column for which page or pages the problem is appearing on and then the far right hand column to see which page is linking to this page or pages. You will then have a better idea where the problem is and how it is being reached by the crawler and that will guide you on where to look to fix it. If you want to give a couple of example urls a few obvious things might stand out.
Hope that helps!
-
By filtered, I meant that we have a profile that filters out employees hitting the site. Sorry, shouldn't have mentioned it because it isn't relevant.
-
Hi Lynn,
Thank you for getting back to me. Here is an image of our diagnostics with the errors.
-
Hi Jessica,
What are the errors telling you? If it is a lot of duplicate content type errors it could be an indication that your site is linking to the same pages in multiple ways. So even though you think your site has xx number of pages, to the crawler (and search engines) it actually has more! Not sure what you mean in regards updating the profile to crawl filtered section of google analytics? If you care to give us an example of the errors and your site we might be able to give more details.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz DA is showing on the serp and one post
Hello Community, I am facing a problem for several days when i search for something in the SERP, Moz doesn't show its da on any of the sites in SERP but when i open the website in a new tab it starting showing there. And 1 post is not showing DA in a new tab even Post URL: https://outdoorbasketballguide.com/best-basketball-hoops-for-toddlers
Product Support | | gabrelaloren1 -
Moz cant crawl site?
We're getting an error saying Moz is getting an errors crawling our client's site, but when I've put this though Google Search Console I'm not seeing any issues - any suggestions?
Product Support | | Ramarketingrob0 -
Remove account from MOZ
I have subscribed for 1 month free Moz trial account. It was free but to subscribe this account I need to put my credit card details. Suddenly at the end of this 1 month term period, Moz tried to cut 149 Dollar from my account without notifying me. But they could not because there were insufficient funds on my credit card. I haven't used any services and would like to remove my account from Moz service? Would appreciate your assistance.
Product Support | | edgarsb0 -
Moz having a few issues with their site?
I've seemed to have a load of issues as of late. Just small graphical things but still enough to make me concerned. 1. https://moz.com/community/users/4207879 being noindex (however it seems to other users an external tools work) (image proof: https://i.gyazo.com/2e77c94ffd068718e9e149e8afef1e44.png ) 2. No mozpoints: https://gyazo.com/9e0777af3ebbdb6ad58a395bafe28a52 3. I'm a staff member? https://i.gyazo.com/5d7b156c13fa1d0bb6c2e0af3467423f.png 4. Trying to respond when logged out: https://i.gyazo.com/9f5fe8efd372920391a9a54178561e0b.png (not really a bug, however could be a better experience) These have all been sent via support, just wondered if it was just me having issues? Seems i'm staff on this one too: https://i.gyazo.com/6f1bc6372180f4f9f1cb1c7d6f6d941c.png
Product Support | | ThomasHarvey0 -
MOZ Profile is not getting update?
It seems like my profile (especially points) is not been updated since the start of this week. any possible reason?
Product Support | | Mustansar0 -
Can we get direct live chat or contact information? Response in the community is not helping and making the process really slow
Its been almost half of the month and our account status is still showing not upgraded. Again and again trying to contact moz via forum and waiting for the response is hampering our work. Kindly let us know how to contact via live chat?
Product Support | | ShaunPhilips0 -
When will MOZ allow you to pull data by a specific date range?
I can only pull by week at the moment. When will it be possible to pull custom date ranges?
Product Support | | webbmason2 -
Custom Anchor text link on Moz profile section
Hi, Does anyone know if you can modify your anchor text and URL after you reach 200 Moz points on your profile section (On the web section under image)? I am close to getting my 200 pts (btw...enjoyed the entire journey) and am trying to choose my anchor text. Here is some interesting analysis too. I have a Spanish site since we are an Argentinean firm. 1. Would a spanish word as anchor text have any value since Moz.com is an English site? I am think about semantics here and how Google likes only content relevant links. My thought is that it does today but it may not be true in the future if Google is going to do away with linkbuilding and just do semantics and co-citation. Thanks Carla
Product Support | | Carla_Dawson0