Why are only two pages of my site being crawled by MOZ?
-
MOZ is only crawling two pages of my site even though there are links on the homepage, and the robot.txt file allows for crawling. Our site address is www.hrparts.com.
-
I had to remove subdomains from being crawled on the site, and the issue has been resolved. The 301 redirect was an issue, causing MOZ to stop crawling at only two pages, the http and https pages.
-
Thank you for your response, Lauren. Our site only has one major feature that is in Javascript, but the rest of the site is not. We do have a 301 redirect from hrparts.com to www.hrparts.com which is where I believe the issue might be coming from. I am curious whether MOZ has an issue with a 301 redirect in a campaign?
-
Hi there!
Thanks for writing in and sorry about the trouble!
I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
https://www.onely.com/tools/wwjd/ is also a handy tool that makes it super easy to see where links are added or removed by javascript.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Moz doesn't find backlinks for months / link tracking list offline
Hi there
Product Support | | startrek123
I want to share a big problem with you. Moz tracking list seems to be offline or having trouble finding links. I have an example:
The page where the backlink has been placed was created months ago. As you can see on the picture:
Link to the page is http://social.msdn.microsoft.com/profile/tableauxdumonde
Backlink on that page is https://ggongtime.com/ Picture shows clearly that the page of backlink (Microsoft) has been indexed and already has got it's own backlinks in Moz (8) but it is still not linking to the backlink website (ggongtime.com).
I've also attached a picture of page source where you can clearly see that it is a html link and is dofollow.
The problem remains since 3 months and I want to find out what is going on. This Microsoft page is one of example. There are hundreds of other pages being found, or not, and are still not showing up in Link Explorer on website's portfolio.
I want to know if there is a technical problem with link explorer, or anything else, because this is a serious problem for me. moz problem.png0 -
Is is possible to revert reporting to a past crawl date?
Site Crawl report defaults to the last crawl. Is there a way to get data from a previous crawl for comparison?
Product Support | | JThibode1 -
How to fix Moz assigning the wrong keyword to a page
Somehow the Moz tool has assigned the main keyword here this to my Google Structured Data Update page. Most likely, I missed something which caused the error. "Keyword np - /google-structured-data-update/" This is for my page titled "Announcement of Google algorithm updates Impact SEO techniques"The canonical tag links to https://www.hillwebcreations.com/google-algorithum-updates-impact-seo-tactics/ as it should, so I am wondering how to update the keyword Moz associates this page with.Any leads to solving this would be appreciated.
Product Support | | jessential0 -
Link to Moz Pro home 404s, and then I stumbled upon Moz's staging site...
I'm wary of giving more information as it's probably best that little to no one be able to access Moz staging for one reason or another. I should also mention that this was done very unintentionally on my part. That said, from the 404 from Moz Pro home, I tried to access "My QA", and that's when I realized that everything I did thereafter was within staging.moz.com (and posted a question similar to this one). Does Moz permit access to their staging site, or did I stumble upon a mistake - or Moz-stake, if you will?
Product Support | | Lumina0 -
Some of my pages stats are broken
Hello It looks like there is a problem with moz pro? I have some parts of stats missing for some of my pages... Tx
Product Support | | xarax
Seb0 -
Analytic goals in Moz
We should have the ability to see any and all conversions goals, as defined in analytics, in Moz. After all, the whole point of marketing, SEO, PPC, Social, etc. is to drive sales or leads that create sales right? So, why should we have a dashboard tool that doesn't show us the 1 thing that ultimately matters the most? I understand that Moz simply wasn't designed to do this, but I think that should change. After all, we are in this to make money I hope. My 2 Cents. Micha
Product Support | | Multiverse-Media-Group1 -
Is Moz creating a Bunker-Mentality with its Customers?
I’ve been using Moz (and SEOMoz) for almost 3 years. During that time, I’ve found them to be very engaged; however, during the last several months, I’ve found a shift in this philosophy—which is a bit disheartening: SEOMoz used to have a very simple contact-us page that listed an email to the help desk as well as the office. Now, they have the locations of the two Moz offices, with no phone numbers or emails. Moz’s help hub, used to have a form that could be completed when you were having issues. Now, there is only a list of community-managed resources to access. The only way you can find the way to contact their help desk is if something breaks & the website gives you an email help@moz.com. However, this email account seems to get overloaded quite often and you will get a “Delivery Response Failed” message because their inbox is full. Does anyone know how to get a hold of Moz directly? I'm having some issues accessing Moz Analytics and really need help from their support team.
Product Support | | TopFloor4 -
Where is the Moz Pro free trial?
Since SEOmoz become Moz, I can't find the Moz Pro free trial registration page. Anyone?
Product Support | | Elchanan0
