MOZ Crawl help
-
Our MOZ report says it crawled 1800 pages so it reports a lot of errors based on those pages. We don't have that many pages on our site. What is MOZ crawling? I updated the profile to make sure it crawls the filtered page section of Google Analytics.
-
Hey Jessica,
I took a look at your crawl diagnostics and there isn't anything that looks too out of the ordinary. You have 415 duplicate pages, which is over inflating your page count.
Additionally, when I exported your crawl diagnostics CSV I saw a mixture of static URLs and Dynamic URLs. This may mean that you have two coppies of each page being crawled, which could be leading to over inflated page totals. You might want to look at your CMS and make sure that it is not making 2 copies of each page.
Cheers,
Ryan Watson
Business Development Associate | Moz -
Hi Jessica,
Well that's a pretty good mix
Having a bunch of different kinds of errors like that could be due to a combination of issues, but I would think that first of all you have a duplicate content issue either because your cms is creating it through different urls for things like multiple categories, archive pages and that kind of thing or because you have a server setup issue that is allowing access to the same pages through multiple urls (like www vs non www urls). It might well be a combination of these things accounting for different errors so you are going to need to narrow down the data to find out exactly what is going on.
Download your error report in csv, open it in excel and select all and then do ctrl-windows-L combination. This will put your data into a filterable table. You can then go to the headers and filter (for example) only 404 pages or only duplicate title pages. Once you have filtered for a specific error have a look at the left hand column for which page or pages the problem is appearing on and then the far right hand column to see which page is linking to this page or pages. You will then have a better idea where the problem is and how it is being reached by the crawler and that will guide you on where to look to fix it. If you want to give a couple of example urls a few obvious things might stand out.
Hope that helps!
-
By filtered, I meant that we have a profile that filters out employees hitting the site. Sorry, shouldn't have mentioned it because it isn't relevant.
-
Hi Lynn,
Thank you for getting back to me. Here is an image of our diagnostics with the errors.
-
Hi Jessica,
What are the errors telling you? If it is a lot of duplicate content type errors it could be an indication that your site is linking to the same pages in multiple ways. So even though you think your site has xx number of pages, to the crawler (and search engines) it actually has more! Not sure what you mean in regards updating the profile to crawl filtered section of google analytics? If you care to give us an example of the errors and your site we might be able to give more details.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
We at QMetry have purchased the license for Moz and I want to know till when will this subscription last and out of the 3 members who is the admin?
I want to know when the subscription will end for QMetry and we are a team of 3 using Moz, out of 3 of us who is the admin?
Product Support | | vatsala0 -
Moz disconnecting from Google Analytics
Hi A number of our campaigns have been disconnected from GA and every time we connect them it says it has, but when you go back, it is disconnects again. I found this thread on this forum: https://moz.com/community/q/google-reauthorization-in-moz#reply_216161 Is this still relevant? Thanks. Regards
Product Support | | Nikki959
Nikki https://moz.com/community/q/google-reauthorization-in-moz#reply_2161610 -
Why can I not crawl this site
I wanted to add this site as new campaign: new.kbc.be But it won't accept it. Why?
Product Support | | KBC0 -
Has the Moz website update affected my data?
Hi Moz, I can see you are currently updating your website and regularly get either the new or old moz format when I log into my account. When I am in my account and Moz is in the new format my account info including keyword ranking & external followed links dramatically change. I am just trying to investigate if it is a moz issue with data or something else? Help would be appreciated. Thanks a lot, Beth
Product Support | | cmuknbb0 -
How to find first set of Moz rankings?
I'm trying to compare the state of our seo before we started moz to now. I can't find the first set of rankings and on-page grades when I initially setup Moz. I do have access to our first report, but in that first week, I made a number of changes based on the initial crawl/rankings/on-page grades. Anyone know how to get that? Thanks, Ruben
Product Support | | KempRugeLawGroup0 -
Moz Email Subscriptions
Hi Mozzers! We recently had someone leave our company who managed a lot of the Moz stuff we were doing and I have now taken over their role. I have been forwarded their emails and they keep receiving information from Moz such as the "Monthly Moz" and "Upcoming Mozinars", which is great, except I want those emails to now be sent directly to me. I cannot for the life of me figure out how to subscribe to these emails through our Moz profile - please help! Thanks! Sam
Product Support | | BlueLinkERP0 -
How do I access my Full SERP Analysis Report in the new Moz?
Another possibly dumb question... I ran a full SERP analysis report and had it emailed to me, but in the email there's no link to the report. I logged back into Moz, but I can't find the report anywhere. Thanks! BiDFIvG
Product Support | | ScottShrum1 -
Where is the full list of Directories on the new Moz.com website?
I used http://www.seomoz.org/directories almost daily. What's the Moz.com equivalent URL?
Product Support | | BrianAsh0