Crawl a node js page - Why can I only see my frontpage?
-
Hi
When i am trying to crawl my website ( https://www.doorot.com/ ) it can only find my frontpage. It's a node js page. Any one had the same problem or know how to crawl my site in order to see all my pages?
Kasper
-
Hi there!
Sam from Moz's Help Team here - I'm sorry about the trouble!
Unfortunately, this would be a result of our crawler's inability to work with Javascript. If your site is primarily Javascript, then the data you get back with regards to the crawl report won't be completely accurate because of this. There's no real work around that I can recommend for this one, since it is a technical limitation, but I did find some good blog posts and discussions in the Q&A about this when I searched our Help Hub. While the tools and data that rely on our crawl of your site may not return the best results because of that Javascript, your keyword rankings and link profile should work just fine.
You might also want to check out a few tools that are compatible with Javascript, like Botify or Screaming Frog.
I'm really sorry I can't be of more help here; I'll definitely be sure to pass this along to our Product team as feedback on your behalf. Please let me know if there's anything else I can help with, or if there are any follow-up questions you might have!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why my website Backlinks not getting Crawl by Moz?
Hi, I've the query related to backlinks of my website. Some of the high authority sites give backlinks to my website but these links are still not showing in Moz. My website is 6 months old and also continuously getting backlinks from high authority sites but still these are not showing on Moz and also not improving DA and PA of my website. I've also attached the screenshot of Moz link explorer results please check and guide me what to do with website so Moz will consider it and give some authority. And also guide me How much Moz takes time to crawl website backlinks and shown in their link explorer. Website URL: https://www.welderexpert.com Moz Expert Suggestions needed. Thanks, overview?site=welderexpert.com⌖=domain
Link Explorer | | KOidue0 -
Moz error with domain and page authority if no www in my domain
Hello, so our domain is website.com and we do not use www in our domain. Now moz shows our page authority as huge (website. Com) and domain authority very low. But our domain is our page that we rank. Is this due to the fact that we use no www and we rank our main index page? Am I correct? Thanks!
Link Explorer | | advertisingcloud0 -
Moz cannot crawl domain. Also OSE does not work properly on this specific domain?
Hi all, Moz cannot crawl the domein http://www.hoesjescases.nl.
Link Explorer | | Guapa_zwolle
When I open the crawl report I only see one line: <colgroup><col width="229"><col width="287"><col width="420"><col width="370"><col width="141"></colgroup>
| URL | Time Crawled | Title Tag | Meta Description | HTTP Status Code |
| http://www.hoesjescases.nl | 2015-10-05T12:20:48Z | 404 : Received 404 (Not Found) error response for page. | Error attempting to request page; see title for details. | 404 | Also when running OSE on this domain, Moz only can find 4 root domains while Majestic can find 91 domains. Google seems not to have any problems. What can be the problem for MOZ? Greetings!0 -
Why do my spammy backlinks still appear on my Open Site Explorer page after removal?
I used the organic spam backlink removal tactic of emailing owners of sites of spam rank 7 or higher on my page. It has been weeks since many of the harmful links were removed, yet they remain listed on my Open site Explorer page. My fear is that somehow simply getting these links removed doesn't exempt me from the potential to be penalized by Google crawlers. Does it take longer than a few weeks for these links to disappear from the Open Site Explorer, or is there something else I need to be doing? Any and all advice appreciated. Ben
Link Explorer | | SOLVISTA0 -
Local listings aren't being crawled?
Hello, SEO brainiacs. Here is the problem I can't figure out:We have a lot of clients and all of them have local listings, such as Insider Pages, Yahoo local, Bing locals, Yelp, Yellow Pages etc etc etc.
Link Explorer | | seomozinator
And all of those local listing have company's website link. But none of those links are considered (found) in reports, such as opensite explorer or in Link Analysis Section of Moz PRO. I do know that MOZ crawl considers only high DA websites, but all of local listing domains have above 80-90 DA score, so they can't be NOT crawled. I will say that some local listings do appear on very few reports, but far not all of them. So, what can be the problem?0 -
Can I increase my DA with backlinks pointing to the www version ?
Hello Guys, I hope I am posting this in the right section... I was wondering something... I use the www version for my website, So I set the cannonicalisation and the 301 Redirect of non-www to www version. But I checked my website on MOZ (Open Site Explorer) and when I type in mywebsite.com I get 19 DA and 1 PA. When I typed in www,mywebsite.com I get 19 DA and 32 PA. So i would like to have some clarifications about how their domain authority and page authority system work. My PA of the www version is higher than my DA because almost all my link point to the www version and I do the 301 redirect. ? But how can I increase my DA if I focus on building backlink to the www version of my website ? Should I build link to the non-www version of my website to increase my DA even if I use the www version for my website ? If I build backlink to the non-www version, will it increase the PA of the www version since it's has a 301 redirect ? If I build backlink to the www version of my website will it increase the DA of my website ? Im really confused here so any help and clarification from you guys will be really appreciated. Thank You.
Link Explorer | | majesticlub0 -
Psst Did you see Open Site Explorer's New Link Building Opportunities Section??
Check out Rand's blog post about it for all the details: http://moz.com/blog/open-site-explorers-new-link-building-opportunities-section. We'd love for you to check it out and leave us your feedback! Thanks,
Link Explorer | | jennita
Jen3 -
Links from no-indexed pages in Open Site Explorer
I just looked up a site in Open Site Explorer. After putting in the site, I get a list of domains, links etc which is very useful. At the bottom is a note which I have pasted below. It mentions "24 links from no-indexed pages" and says we can't get any info on these. Is there a way to see what the 24 links are so I can investigate further?"Why does my number of inbounds links listed not match my total links count? The listed number may be slightly different because we only show 25 links per domain (so that you see a variety). Additionally you have 24 links from no-indexed pages. Unfortunately, we can't get info for those links."
Link Explorer | | EdKim0