Why are only two pages of my site being crawled by MOZ?
-
MOZ is only crawling two pages of my site even though there are links on the homepage, and the robot.txt file allows for crawling. Our site address is www.hrparts.com.
-
I had to remove subdomains from being crawled on the site, and the issue has been resolved. The 301 redirect was an issue, causing MOZ to stop crawling at only two pages, the http and https pages.
-
Thank you for your response, Lauren. Our site only has one major feature that is in Javascript, but the rest of the site is not. We do have a 301 redirect from hrparts.com to www.hrparts.com which is where I believe the issue might be coming from. I am curious whether MOZ has an issue with a 301 redirect in a campaign?
-
Hi there!
Thanks for writing in and sorry about the trouble!
I took a look at your Site Crawl results and your site, and I believe this is a result of our crawler's inability to work with Javascript. Any client side loaded content will not be rendered to our crawler as we are only seeing what is rendered by your server.
Our crawler works by parsing the source code of your site, looking at HTML elements. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real workaround that I can recommend for this one, since it is a technical limitation of our tools, but there are some good blog posts and discussions in the Q&A about this if you head over to our Help Hub.
While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
https://www.onely.com/tools/wwjd/ is also a handy tool that makes it super easy to see where links are added or removed by javascript.
I'm really sorry I can't be of more help here; Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz Reporting -Selecting Dates
How to I select what dates to report from? I would like a quarterly report - is it possible to compare to the previous year/quarter?
Product Support | | kaymcgarr0 -
Is it possible to get a refund, I dont want to use MOZ
Well I entered my cc info to try MOZ out. Havent used it so I forgot to cancel my subscription. They have since billed me for a month. I wanted to know if it is possible to get my money back?
Product Support | | Bryton1 -
No crawl data anymore
Using moz quite some time, but I don't have any crawl data anymore. What happened? (www.kbc.be)
Product Support | | KBC
http://analytics.moz.com/settings/campaign/517920.11285160 -
Why have I been charged by Moz for a Pro Subscription
I recently used the trial free 1 month subscription for Moz Pro as it was suggested in a continued education course I was doing. I see before I could say "Jack Rabbit" they have charged me and it has come off my account for next month. They also took the money off my account also happened after I queried the invoice received this morning and after immediately cancelling the trial period. This is unethical. Currently Moz Pro a service charged in US$ is too expensive for my consultancy in South Africa. Any advice on how to get this amount reversed. Today is the day the invoice was sent and immediately afterwards they charged me the amount.....
Product Support | | creativecase0 -
Moz pricing plans don't make sense
Hey. I posted a question about this on my other Moz account (one I use for moz local), but it appears to have been removed, so here goes again. Can someone from Moz please explain to me why that in your plans, as the price goes up and more campaigns are allowed, the amount of keywords tracked per campaign goes down? $149 plan - 5 campaigns - 450 keywords = 90 keywords per campaign. $249 plan - 25 campaigns - 1100 keywords = 44 keywords per campaign $599 plan - 100 campaigns - 3700 keywords = 37 keywords per campaign What confuses me here with your pricing plans is two fold Modern SEO requires a lot of quality content, interlinked together to rank well (in most cases). Your SEO guides even talk about this. Blogging is one of the most popular ways to do this. However, in any modest website these days, especially one that runs a blog, how does tracking only 37 keywords per campaign make sense? The fact is, that even your starter plan with only 90 per campaign doesn't make sense. My business website is tracking about 300 (that actually drive traffic). I provide my SEO clients with the same type of work I would do for my self, which again reinforces that 37 keywords is plainly pathetic. Every online pricing model I've ever seen follows one simple rule: When price goes up, you get more for your money, not less. At first glance you might think that is what you're getting when you step up a plan and get more campaigns, but then to have less keywords per campaign simply doesn't make sense at all. What does make sense is to have a more flexible pricing model. Instead of locking us into set tiers which don't really make sense, you should allow a more flexible pricing BEFORE we have to go up to enterprise. Why not have a per project price of 'x' price per month, then have a price per keyword or maybe per 100 keywords. This would allow all of us the flexibility to run campaign depths that make sense for us, not for your counterintuitive views of how we should be tracking them. Again, I'd really like a Moz staff person to respond to this as the last time I commented about this, it was removed.
Product Support | | Multiverse-Media-Group0 -
Dude Phishing on Moz
Hey guys - just so you know I got this today from a ghost on Moz. Hello,
Product Support | | Chenzo
I like your profile in this moz.com community network and I think you are a nice person. Can we get in contact? I'm sorry if i am embarrassing you, I got curious to know you better after viewing your profile i think that i have something important to exchanged with you i shall explain more about myself including my pictures, please E-mail me to not in this site because i am a new in this community and i don't visit this site often, I'd like to get to know you if you don't mind
Please i will Tell you more about my self
thanks & regardsFigured I would share and keep you up to date.Your pal,Chenzo1 -
The websites I add to my Moz Analytics account do not appear in the old "Pro" account. What is going on here?
The websites I add to my Moz Analytics account do not appear in the old "Pro" account. What is going on here?
Product Support | | GameDay1 -
Email address for moz.com?
I signed up for a trial on seomoz and today i found out moz.com has charged me for a subscription without my knowledge. how can I contact them?
Product Support | | iareef0