Angular SPA & MOZ Crawl Issues
-
Website: https://www.exambazaar.com/
Issue: Domain Authority & Page Authority 1/100
I am using Prerender to cache/render static pages to crawl agents but MOZ is not able to crawl through my website (https://www.exambazaar.com/). Hence I think it has a domain authority of 1/100. I have been in touch with Prerender support to find a fix for the same and have also added dotbot to the list of crawler agents in addition to Prerender default list which includes rogerbot. Do you have any suggestions to fix this?
List: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
Adding dotbot to Express Server:
prerender.crawlerUserAgents.push('dotbot'); -
Cheers Gaurav
I will try that technique. We use something similar for the title but in the Angular app.js file, however have struggled to do the same for the description, canonical tags etc.
Actually right now we add the tags we need in Javascript, using the DOM and prerender and google seems to like it. We can;t run a crawl any longer in the std Moz package for some reason we can only do one per week now. Moz doesn't seem to cope too well with the Javascript though. When we tried other tools it seemed to c heck out fine.
I'm not sure if it is Moz crawlers that are causing us the issue here, anyway!
We're also still using Angular 1.6 so we really need to upgrade to v4 or at least 2.
-
Hi Dave
Thanks for asking. You can set the pageDescription variable (similarly for other meta tags) in each route/state of the SPA which gets cached by Prerender. If you are using prerender you can see the list of default crawler agents supported here: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
If you wish you can enable prerender for the crawler dotbot too!
-
Hi Gaurav
We're also launching a new MEAN SPA, We've gotten our site looking quite good for SEO now, other than the meta description and canonical tags.
However I believe the MOZ crawler still doesn't understand javascript, we use AngularJS or JQEURY to change and add the meat tags for each page, which I am confident is OK with Google but MOZ and SEMRush don't like it.
That could be something to do with the lower score on Moz?
Do you mind me asking how do you set your page meta descriptions and canonical tags?
Dave
-
Hey, Dave from the Help Team here!
I just ran your site through our crawler and didn't have any issues crawling your site. I think the Domain Authority score of 1/100 is actually caused by us not having your site in our Mozscape Index. To find out more about how we Index the web, you can read about it here
https://moz.com/help/guides/research-tools/open-site-explorer/updates/index-process
Hopefully that helps to clarify, let us know if you need anything else!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why is there difference in keywords of moz and ahrefs
Hello, my welding helmets website Helmet Adviser is about reviews and is causing me confusion. When I check my site keywords in Moz it shows lesser keywords and when I check in ahrefs it shows more. Same is for backlinks. But Moz keywords research is very authentic and i want to rely on it for keywords and backlinks too. Please elaborate for me why is there diff between Moz and ahref, so I can better utilize Moz by understanding what is going on in the background.
Link Explorer | | ericcampbell10 -
My Website's Links Are Not Showing In Moz Link Explorer
Hello Team, I was analyzing my domain (https://www.amzonestep.com) in link explored but there are many websites that are not showing there. Questions
Link Explorer | | amzonestep
1. Is this reason website's DA is not increasing 2. Is there wrong steps taken by me for this website. Well, I know there are many factors work in increasing DA but what is should do if these kind on links are not indexing in MOZ. I things these are one of the factors my DA is not Increasing. Please save my job guys. The company has sent me an ultimatum mail of 2 months that they will take back the projects from me. Please save my job. Thanks & Regards Aashirvad Kumar moz.png Screenshot-2020-02-19-at-11.48.21-am.png0 -
Need help understanding this Moz Chart comparing link metrics against competitors...
Why is my website at 60% and what does it mean? And more importantly, what needs to be done to fix (or not fix) this situation??? Please help... Image of chart attached kcd5r40
Link Explorer | | SamCitron0 -
6 Months and still no PA/DA or links by Moz Explorer?
Hi, It's been 6 months and my site is still showing no PA/DA or backlinks according to moz opensite explorer. I know that it has backlinks as I created them myself, and I know its crawlable and the links is there as GWT tells me so. Also you can check for yourself on ahrefs.com. Is Moz indexed pages that much smaller then the other crawlers? The site in question is amanandvan247.com. Thanks.
Link Explorer | | Marvellous1 -
Can't make sense of OSE and MOZ.
I checked this site on my OSE and it shows only 7 inbound links a DA of 14 and no social activity whatsoever yet when I check it on Majestic it shows ExternalBacklinks 71 ReferringDomains 20 Referring IPs 19 Referring Subnets 19 . And.. the page is #1 on google search for hypnotherapy michigan. How can it rate so poorly on MOZ, show so much more on majestic and rank so high on google? I thought MOZ data was supposed to be among the best and that top rated pages on google should also rate high on MOZ. here is the site http://hypnotherapy-detroit.com Additionally, when i look at the site, i notice that most of the backlinks are exchanged links and this site's link exchange page isn't even linked from the home page. Now I thought that kind of link exchange game was now discounted by Google. I don't get it. No social pages at all... low page rank... no new content.. so by MOZ standards there is no justification for this page to be anywhere near page one let alone at position #1. Can someone help me make sense of all this?
Link Explorer | | HypnoPro0 -
The difference between the statistics MOZ & Ahrefs
Hello dear. I have a website for a year. I made 10K links in one year(from 45 Root Domains).the Ahrefs.com has show full list of link root domains and pages. the ahrefs rank is 49. but MOZ said my Established Links are 5! So I have some questions, please help me: 1- what is difference between MOZ rank and ahrefs rank? 2-When Just-Discovered Link Calculate for my site? 3-why my moz trust is 0.00!?How to improve it? URL: https://esta-register.org
Link Explorer | | allyunit0 -
How long does it take for moz to index new domain?
Hi, Two months ago we changed our site www.jicht.nl to jicht.nl. Everthing is redirected properly but the page authority remains 1. How long does is take rogerbot to index the site without www? Google rankings are also dropping so there might be a bigger issue. Thanx
Link Explorer | | AlkaVitae0 -
Moz crawling bot
Hi guys, in OpenSiteExplorer -> Top Pages, there are no page titles displayed in a raport for certain domain, and "HTTP Status" column shows: "Blocked by robots.txt". I tried to find out what the ID of Moz crawling bot is, and on this page: http://moz.com/community/q/seomoz-spider-bot-details someone says it's: Mozilla/5.0 (compatible; rogerBot/1.0; http://www.seomoz.org/dp/rogerbot). However, my robots.txt doesn't have such entry. Take a look: Automatically banned scanners and crawlers section User-agent: 008 Disallow: / user-agent: AhrefsBot Disallow: / User-agent: MJ12bot Disallow: / User-agent: metajobbot Disallow: / User-agent: Exabot Disallow: / User-agent: Ezooms Disallow: / User-agent: fyberspider Disallow: / User-agent: dotbot Disallow: / User-agent: MojeekBot Disallow: / Section end What could be the problem here, then? Why does the Moz bot think I'm blocking it?
Link Explorer | | superseopl0