Angular SPA & MOZ Crawl Issues
-
Website: https://www.exambazaar.com/
Issue: Domain Authority & Page Authority 1/100
I am using Prerender to cache/render static pages to crawl agents but MOZ is not able to crawl through my website (https://www.exambazaar.com/). Hence I think it has a domain authority of 1/100. I have been in touch with Prerender support to find a fix for the same and have also added dotbot to the list of crawler agents in addition to Prerender default list which includes rogerbot. Do you have any suggestions to fix this?
List: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
Adding dotbot to Express Server:
prerender.crawlerUserAgents.push('dotbot'); -
Cheers Gaurav
I will try that technique. We use something similar for the title but in the Angular app.js file, however have struggled to do the same for the description, canonical tags etc.
Actually right now we add the tags we need in Javascript, using the DOM and prerender and google seems to like it. We can;t run a crawl any longer in the std Moz package for some reason we can only do one per week now. Moz doesn't seem to cope too well with the Javascript though. When we tried other tools it seemed to c heck out fine.
I'm not sure if it is Moz crawlers that are causing us the issue here, anyway!
We're also still using Angular 1.6 so we really need to upgrade to v4 or at least 2.
-
Hi Dave
Thanks for asking. You can set the pageDescription variable (similarly for other meta tags) in each route/state of the SPA which gets cached by Prerender. If you are using prerender you can see the list of default crawler agents supported here: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
If you wish you can enable prerender for the crawler dotbot too!
-
Hi Gaurav
We're also launching a new MEAN SPA, We've gotten our site looking quite good for SEO now, other than the meta description and canonical tags.
However I believe the MOZ crawler still doesn't understand javascript, we use AngularJS or JQEURY to change and add the meat tags for each page, which I am confident is OK with Google but MOZ and SEMRush don't like it.
That could be something to do with the lower score on Moz?
Do you mind me asking how do you set your page meta descriptions and canonical tags?
Dave
-
Hey, Dave from the Help Team here!
I just ran your site through our crawler and didn't have any issues crawling your site. I think the Domain Authority score of 1/100 is actually caused by us not having your site in our Mozscape Index. To find out more about how we Index the web, you can read about it here
https://moz.com/help/guides/research-tools/open-site-explorer/updates/index-process
Hopefully that helps to clarify, let us know if you need anything else!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why are my trackable links appearing in my site crawls?
Our Google-created trackable campaign URLs are appearing in site crawls and often triggering error warnings.
Link Explorer | | K.Reeves0 -
Need help understanding this Moz Chart comparing link metrics against competitors...
Why is my website at 60% and what does it mean? And more importantly, what needs to be done to fix (or not fix) this situation??? Please help... Image of chart attached kcd5r40
Link Explorer | | SamCitron0 -
Can you do custom date comparisons in Moz?
The only options I see in the tab is weekly and monthly. What if, for example, I wanted to compare stats over a 3 month period? Or compare stats from the same month last year? Is that possible? Or even the stats from the beginning of a campaign? Do you have to manually track them?
Link Explorer | | trypm1 -
Does moz pro standard give access to open site explorer & keyword explorer?
Does moz pro standard give access to open site explorer & keyword explorer?
Link Explorer | | SearchOpt1 -
Pagination & Duplicate Page Title
I was under the impression that pagination resolved duplicate page title issues with Google, but Moz is flagging them up as duplicates. Is this just a case of Moz not being able to understand pagination or am I missing something? i.e. correctly formatted pagination: http://thespacecollective.com/space-memorabilia/page/4
Link Explorer | | moon-boots1 -
I crawled my site, but an old crawl report still is visible
I crawled my site recently, but an old crawl report still is still all I can see
Link Explorer | | Bigjim0 -
6 Months and still no PA/DA or links by Moz Explorer?
Hi, It's been 6 months and my site is still showing no PA/DA or backlinks according to moz opensite explorer. I know that it has backlinks as I created them myself, and I know its crawlable and the links is there as GWT tells me so. Also you can check for yourself on ahrefs.com. Is Moz indexed pages that much smaller then the other crawlers? The site in question is amanandvan247.com. Thanks.
Link Explorer | | Marvellous1