Angular SPA & MOZ Crawl Issues
-
Website: https://www.exambazaar.com/
Issue: Domain Authority & Page Authority 1/100
I am using Prerender to cache/render static pages to crawl agents but MOZ is not able to crawl through my website (https://www.exambazaar.com/). Hence I think it has a domain authority of 1/100. I have been in touch with Prerender support to find a fix for the same and have also added dotbot to the list of crawler agents in addition to Prerender default list which includes rogerbot. Do you have any suggestions to fix this?
List: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
Adding dotbot to Express Server:
prerender.crawlerUserAgents.push('dotbot'); -
Cheers Gaurav
I will try that technique. We use something similar for the title but in the Angular app.js file, however have struggled to do the same for the description, canonical tags etc.
Actually right now we add the tags we need in Javascript, using the DOM and prerender and google seems to like it. We can;t run a crawl any longer in the std Moz package for some reason we can only do one per week now. Moz doesn't seem to cope too well with the Javascript though. When we tried other tools it seemed to c heck out fine.
I'm not sure if it is Moz crawlers that are causing us the issue here, anyway!
We're also still using Angular 1.6 so we really need to upgrade to v4 or at least 2.
-
Hi Dave
Thanks for asking. You can set the pageDescription variable (similarly for other meta tags) in each route/state of the SPA which gets cached by Prerender. If you are using prerender you can see the list of default crawler agents supported here: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
If you wish you can enable prerender for the crawler dotbot too!
-
Hi Gaurav
We're also launching a new MEAN SPA, We've gotten our site looking quite good for SEO now, other than the meta description and canonical tags.
However I believe the MOZ crawler still doesn't understand javascript, we use AngularJS or JQEURY to change and add the meat tags for each page, which I am confident is OK with Google but MOZ and SEMRush don't like it.
That could be something to do with the lower score on Moz?
Do you mind me asking how do you set your page meta descriptions and canonical tags?
Dave
-
Hey, Dave from the Help Team here!
I just ran your site through our crawler and didn't have any issues crawling your site. I think the Domain Authority score of 1/100 is actually caused by us not having your site in our Mozscape Index. To find out more about how we Index the web, you can read about it here
https://moz.com/help/guides/research-tools/open-site-explorer/updates/index-process
Hopefully that helps to clarify, let us know if you need anything else!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Issue with former site redirect
Hello, After 2 months of starting a new service with a new domain name and a rather flat curve, I decided to invest in auditing tools. To my surprise, when analyzing links with 'Link Explorer', I got the following warning : "You entered the URL crapahute.com which redirects to www.krapahute.com. Click here to analyze www.krapahute.com instead."... So I understand I bought a domain name that was previously in use, 8 years ago. And logically, when they moved from crapahute.com to krapahute.com, the former site owners set a (probably 401) redirect between their former name and their new one. Probably that in the last 8 years they dropped crapahute.com since I was able to buy the domain name last year. I can't understand the warning I'm receiving. since I thought this redirect would become inactive when they dropped the domain name. On the contrary, if I analyze the backlinks to krapahute.com I can indeed see : crapahute.com [no anchor text] 3 2 0 --
Link Explorer | | x_all
redirect More Info
Date first seen - Date lost - Link target
2016-09-05 - N/A - www.krapahute.com So my question is : where is this warning coming from ? I performed some nslookup and dig on my domain and their's just to find out that every thing seems to look normal. Meanwhile, if I type "crapahute" in Google (and most other search engines), my site arrives in 12th page (!), and if I type "crapahute.com", the site "krapahute.com" appears first. Thank you for those reading up to that point ! Any hint on what could cause this ? Should I change of domain name ? Thank you !0 -
Does Moz register backlinks from Twitter/Facebook/LinkedIn?
I've noticed that on sites with decent social presence and regular content posts that Moz isn't showing/recording any inbound links from Twitter, Facebook or LinkedIn. Posts are regularly shared via these three channels but no inbound links ever seem to show up. Does Moz not record such inbound links, or are they all disguised using JavaScript or some other trick?
Link Explorer | | JCN-SBWD0 -
Spam Score and crawling of my site
Hello, I'm trying to analyze the spam score of my site which is 9/17 Actually I have few backlinks and all of them have a low spam score (max 4/17, just one). I think there's some kind of issue with the crawler since I get strange spam factors: Large Site with Few Links (likely true, I recently deleted a lot of tags used once) Low Number of Pages Found (wasn't it a "Large Site"??) Low Number of Internal Links (I got a considerable number) No Contact Info (I have a link to my facebook in the menu and a "contacts" page) Thin Content (It's just a blog with min 300 words per post, why thin?) Site Link Diversity is Low (likely true) Ratio of Followed to Nofollowed Subdomains (likely true) Low MozTrust or MozRank Score (true) Ratio of Followed to Nofollowed Domains (likely true) Can you please help me to understand it, is it a crawling problem or similar? If needed I will post the url of the website. Thank you so much Marco
Link Explorer | | MarcoBP0 -
Why Moz Back links check tool is very Slow compared with other tools?
I've created a new website 50 days old with a vision of sharing high-quality content. I created some pages which are useful and helpful, what make other people link to my site. Early days, two weeks ago I've started checking my backlinks starting with Ahref and majestic. three days ago I decided to join Moz too and use Moz explorer. But, I discovered that Moz tool is too slow compared with other tools. Why? Starting with Ahref. They discovered more than 100 links and updating their data for my site as a new website every 6 hours as I know. Also majestic for the first time discovered six links then every two days they updating their data. Even Google discovered some of my backlinks. Specially links from high-quality sites such as Wikipedia with high-quality pages. Moz tool discovered zero of my backlinks even after subscribing. I don't think Moz need to discover websites like Wikipedia which already indexed by Moz. So, I wonder Why Moz tools are very very very slow like that? Update: (This is a question, not a discussion. So, please don't edit it) Can any Moz support answer please? Thanks.
Link Explorer | | Eslam-yosef0 -
Duplicated content detected with MOZ crawl with canonical applied
Hi there! I have a slight problem.
Link Explorer | | Eurasmus.com
I have a site with Joomla 3.3 that we recently migrated from 2.5. Joomla, for some reason that I don´t really get, creates hundreds of weird urls for the site like
mydomain.com/en -> joomla creates en/home/149-xxx-xxx/xxxxxx-xxxxxx that links to the first one.
The new version 3.3 knows this bug and applies a rel=canonical to the ones created "artificially", so they should not be identified as duplicated. Sample piece of code: en/home/149-all-en/xxxxxxx-xxxxxx" rel="canonical" / MOZ crawler identifies this as duplicated and like this I have thousands of pages duplicated all with titles, content etc... all the ones created by joomla. Still my site has good SEO results and I can not see any penalties but I am a bit concerned they may come in the future.... Can anyone explain me what is happening? Thank you in advance for your time,0 -
How Does Moz Assign Domain Authority?
When I use Site Explorer to test the following URL, http://jennathuening.results.net/site/index.php, it renders a domain authority of 47. (Clients site on real estate host) There are no page social metrics: no Facebook share no Facebook likes no Twitter tweets no Google+ plus 1's no "just discovered" in 60 days no one has made a post in 3 weeks much or most of the content is duplicate content across all affiliate sites inbound links - only one link - a 301 redirect http://jennathuening.results.net/ Images - 18 (Alt tags missing: 18) Created - 1998-10-15 Registered Org - REMAX RESULTS is associated with ~416 other domains Whois SEO Score 68% AND YET IT HAS A ROOT DOMAIN OF "47" and page authority of 33 More confusing, its page authority of 33 is at that top on blue background and then page 30 just listed below. When I use Site Explorer to test the following URL, http://www.homedestination.com, it renders a domain authority of 26. (Site personally owned and continually update with highly optimized fresh, relevant, quality content with grade "A" moz ranked pages and blog posts) 92 Facebook share 68 Facebook likes 13 Twitter tweets 420 Google+ plus 1's 2 "just discovered" in 60 days Images 25 (Alt tags missing: 0) inbound links - on 48 Root Domains Created - 2002-08-15 9 new indexed blog post so far in August / 19 new indexed blog post in July Whois SEO Score 100% AND YET IT HAS A ROOT DOMAIN OF "26" and page authority of 36 While I am sure there are many other factors as well; it still is hard to see where a "smaller guy" could ever be given an even opportunity to play in the same SEO arena. Could you help me understand better? I like to build a stronger marketing and optimization strategy as we are just beginning AdWord campaigns. | SEO Score | 100% |
Link Explorer | | jessential1