Why are only two pages of my site being crawled by MOZ?
-
MOZ is only crawling two pages of my site even though there are links on the homepage, and the robot.txt file allows for crawling. Our site address is www.hrparts.com.
-
I had to remove subdomains from being crawled on the site, and the issue has been resolved. The 301 redirect was an issue, causing MOZ to stop crawling at only two pages, the http and https pages.
-
Thank you for your response, Lauren. Our site only has one major feature that is in Javascript, but the rest of the site is not. We do have a 301 redirect from hrparts.com to www.hrparts.com which is where I believe the issue might be coming from. I am curious whether MOZ has an issue with a 301 redirect in a campaign?
-
Hi there!
Thanks for writing in and sorry about the trouble!
I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
https://www.onely.com/tools/wwjd/ is also a handy tool that makes it super easy to see where links are added or removed by javascript.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I delete a question that I previously posted on Moz?
I posted a question with links to a website. That question now appears in google search when I search for that website, which I don't want. Can I delete the question I posted on Moz?
Product Support | | LavM1 -
Campaign Tracking on Site with different CMS systems
Hello, We have a lot of international tracking issues. our site is www.avepoint.com/de our blog site is www.avepoint.com/blog/de The main site is hosted on Craft CMS, the other is on WordPress. Right now I am not seeing any rankings for blogs on our WordPress site but am seeing that I am winning words in Germany when I use google ad preview. I see good ranking stats for the main site. I am not sure why I cant see any data for the blog site. Any ideas what might be wrong or how I can fix it? Thanks, Amanda
Product Support | | AvePoint1 -
Can 2 Moz profiles be merged?
I'm very excited to have received my promotion into the Moz Specialist category (yea me!) , but I've discovered that I have another Moz profile dating back to 2011. Can they be merged together?
Product Support | | julie-getonthemap0 -
SEO Campaign for testing site?
We are in the process of a website redesign and have initiated an SEO campaign on the current site to set benchmarks. Does it make sense for us to run a separate SEO campaign on the testing site as well? Michelle
Product Support | | Michelle-Meyer0 -
How unsubscribe to Moz
Hi, I want know how to unsubscribe from Moz, there is no options in "Billing and Subscription" ? Thank you in advance.
Product Support | | pharmacieDefrance1 -
Moz Pro Free trial
Hi i got a coupon code from a hosting company for Moz seo 4 month free trial however after registering and entering my information i was charged 99$ even though it said todays charge = $ 0 i would like a refund as it doens't seem to a be a free trial
Product Support | | zemosdesign0 -
I'm tired of logging in to MOZ
I like this site, I really do, which is why I visit multiple times a day. But I grow weary of these premium sites that require me to log in multiple times a day. This morning I was simultaneously working at ordercup.com, strengthcoach.com, and moz.com, and all three log me out at every turn. Argh!!! What's worse is that some MOZ pages think I'm logged in and others don't. I don't fully understand the logic behind the curtain, so I wander from page to page trying to get the login in sync. Why can't these sites work like lynda.com where I can stay logged in for days and weeks? To top it off, LastPass rolled out a new release that broke auto-login. All this logging in is getting in the way of me getting anything done.
Product Support | | ChristopherGlaeser3 -
Several issues moz analytics
I have found several issues with Moz Analytics. Wondering if it is only me or am I missing something... 1. I am not able to create branded reports or reports what so ever. I need this functionality like it is advertised.
Product Support | | auke1810
2. In Search competition is not working at all. it states "not in top 50" for all keywords witch is not true.
3. In Crawl diagnostics I get this "Rel Canonical" issue even though the rel canonical tag is in the website. I have send a mail to support but no answer until today. Earlier I did receive a answer on my questions so i guess there is one way of sending questions to the moz team witch is not working.0
