Why are only two pages of my site being crawled by MOZ?
-
MOZ is only crawling two pages of my site even though there are links on the homepage, and the robot.txt file allows for crawling. Our site address is www.hrparts.com.
-
I had to remove subdomains from being crawled on the site, and the issue has been resolved. The 301 redirect was an issue, causing MOZ to stop crawling at only two pages, the http and https pages.
-
Thank you for your response, Lauren. Our site only has one major feature that is in Javascript, but the rest of the site is not. We do have a 301 redirect from hrparts.com to www.hrparts.com which is where I believe the issue might be coming from. I am curious whether MOZ has an issue with a 301 redirect in a campaign?
-
Hi there!
Thanks for writing in and sorry about the trouble!
I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
https://www.onely.com/tools/wwjd/ is also a handy tool that makes it super easy to see where links are added or removed by javascript.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Can Moz integrate GA4 data?
With the new GA4 coming out in 2023, can our Moz accounts connect to the new GA4 property?
Product Support | | ArttiaCreative0 -
Moz is not showing difficulty and Priority from last day. can any body help?
i was just trying to check a keyword difficulty but when i put my kw the difficulty and priority is showing like this ( - ). can any one help? thanks
Product Support | | ayybeedee1 -
I have a client who wants to have their own Moz login. I want to move them out on to a new plan from the Standard (5 campaigns) plan. Can I do this?
For years I've been managing campaigns in Moz through Moz Pro. This enables up to 5 campaigns. One of my clients wants access to their campaign and are happy to pay for a new Moz Standard account just for them. My question is - can this be done? They would like my company (or more specifically me) to still have admin access to the account. I'm confused as to whether multi-seat is the right way to go? I don't want my client to login to my current Moz Pro account as I have other client's campaigns on it. Can anyone help as to the best approach.
Product Support | | T_Cooper0 -
Moz showing zero traffic GA showing activity
Hey guys Im sure this question has been asked before but I could not find it. I promised I looked hard. I hooked up my account three days ago. For some reason Google Analytics is showing that I am indeed getting some good traffic to my site. But Moz is reporting zero zero zero across the board for anything and showing I have zero back links which is not correct. I thought it would eventually start working but its not. Any suggestions?
Product Support | | Answer2cancer0 -
Why is Moz Crawl Diagnostics labelling pages as duplicate when they appear to be different?
Moz Crawl Diagnostics is flagging some pages on the Doorfit website as duplicate, yet the page content is completely different and not identical. Example. Page: http://www.doorfit.co.uk/locks-security/secondary-security Duplicate: http://www.doorfit.co.uk/seals-and-sealants?cat=279 Does anybody have any suggestions as to why this might be the case? Thanks
Product Support | | A_Q0 -
Is there a way to export the dashboard in the new MOZ?
I would like to export the dashboard to send to a client. Is there a way to do this other than taking a screenshot?
Product Support | | webbmason0 -
Anybody know how to merge an old inactive Moz account with a current live Moz account?
I had an old Moz account with my name, profile, etc. that I don't want to lose. By accident, when I created my current subscription, I ended up creating a brand new account. The old account has my bio, Moz points, etc. that I don't want to lose, but the new account has my campaigns. Any way to bring the two accounts together?
Product Support | | Consumers-Edge.com0 -
Archived campaigns not in Moz Analytics
Hi team! Working in the awesome new Moz Analytics, I happened to notice that all (but one) of our archived campaigns seem to be missing from Moz Analytics (in the "Manage Your Campaigns" area). Have we jumped the gun and perhaps they're still working their way over in the migration? If so, do they have an estimated arrival date? Any light which can be shed on this is much appreciated. Thanks team!
Product Support | | wh-seo0