Angular SPA & MOZ Crawl Issues
-
Website: https://www.exambazaar.com/
Issue: Domain Authority & Page Authority 1/100
I am using Prerender to cache/render static pages to crawl agents but MOZ is not able to crawl through my website (https://www.exambazaar.com/). Hence I think it has a domain authority of 1/100. I have been in touch with Prerender support to find a fix for the same and have also added dotbot to the list of crawler agents in addition to Prerender default list which includes rogerbot. Do you have any suggestions to fix this?
List: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
Adding dotbot to Express Server:
prerender.crawlerUserAgents.push('dotbot'); -
Cheers Gaurav
I will try that technique. We use something similar for the title but in the Angular app.js file, however have struggled to do the same for the description, canonical tags etc.
Actually right now we add the tags we need in Javascript, using the DOM and prerender and google seems to like it. We can;t run a crawl any longer in the std Moz package for some reason we can only do one per week now. Moz doesn't seem to cope too well with the Javascript though. When we tried other tools it seemed to c heck out fine.
I'm not sure if it is Moz crawlers that are causing us the issue here, anyway!
We're also still using Angular 1.6 so we really need to upgrade to v4 or at least 2.
-
Hi Dave
Thanks for asking. You can set the pageDescription variable (similarly for other meta tags) in each route/state of the SPA which gets cached by Prerender. If you are using prerender you can see the list of default crawler agents supported here: https://github.com/prerender/prerender-node/commit/5e9044e3f5c7a3bad536d86d26666c0d868bdfff
If you wish you can enable prerender for the crawler dotbot too!
-
Hi Gaurav
We're also launching a new MEAN SPA, We've gotten our site looking quite good for SEO now, other than the meta description and canonical tags.
However I believe the MOZ crawler still doesn't understand javascript, we use AngularJS or JQEURY to change and add the meat tags for each page, which I am confident is OK with Google but MOZ and SEMRush don't like it.
That could be something to do with the lower score on Moz?
Do you mind me asking how do you set your page meta descriptions and canonical tags?
Dave
-
Hey, Dave from the Help Team here!
I just ran your site through our crawler and didn't have any issues crawling your site. I think the Domain Authority score of 1/100 is actually caused by us not having your site in our Mozscape Index. To find out more about how we Index the web, you can read about it here
https://moz.com/help/guides/research-tools/open-site-explorer/updates/index-process
Hopefully that helps to clarify, let us know if you need anything else!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Looking for someone from Moz to comment on unrealistic spam score
Two years ago I bought domain name aroundtheworldwithme.com as a travel blog. I built the site up slowly and currently have a DA of 28 with decent Google search results. However, according to Moz my spam score is 43%. I am convinced that something funny is going on to give me this spam score. I have gone though all 27 factors that play into the spam score in great detail. I only fail a few of the checks. These are the Double Click Tag, LinkedIn profile, phone number, email, and Facebook Pixel. Which as far as I know, literally zero travel blog websites provide this info. So I am on par with evert other travel blog website. Now I know Moz will say this "doesn't mean your website is spam, just that our algorithm found that websites with similar attributes are spam." But this is completely bogus. All similar websites to mine have spam scores of 1-2%. All other websites I see with spam scores over 40% are literally spam websites. Why am I literally the only legitimate travel blog site that has a spam score over 40%? My backlink profile is similar to all other travel blogs. I actually have less spammy links as most, as I haven't been around too long. So I don't think my backlinks are causing the high spam score. The only thing I can think of is that my domain name used to be owned by someone else. I have a lot of backlinks from a random blog website that were discovered in 2018, three years before I bought the domain. Is it possible that the domain used to be an actual spam site name and I am now being punished for that? If not, then I cannot think of anything that would cause my high spam score other than fundamental defects in the Moz spam score algorithm. Something is going on, and I'd love someone from Moz to actually be able to have a look at my website and tell me why I have such a high spam score. I know Google doesn't care about Moz's spam score (thankfully) but other websites don't want links from me due to my completely bogus spam score. Thanks everyone
Link Explorer | | Heckmantis
aroundtheworldwithme.com0 -
Moz crawling http rather than https site
Our site is secure but when I ask moz to crawl it by giving the root domain including https moz insists on crawling the non secure version. How do i force it to crawl the secure version?
Link Explorer | | media12340 -
My site links to my clients not showing in Moz
I've got a web design business with a site that's been out there for 17 years - www.biztoolsone.com. I've got links to my clients' sites in my portfolio page. The backlinks list for my clients, when I check them in Moz, don't show the links from this site. They always showed in the list until a few months ago. The site has a DA of 59 & PA (for home page) of 50. The spam score is 0/17. I'm having a tough time telling my clients that the Moz backlinks list is accurate when that site doesn't show in the list. The same is true for www.fayettevillenc.biz - this is one I created years ago to generate backlinks. It's got a spam score of 4/17, so I'm a little more understanding of that one. Thanks for any guidance!
Link Explorer | | wcksmith10 -
MOZ doesn't work for .dating and .chat domain extensions
I have been a MOZ subscriber for a few years now. I don't think MOZ works for .dating and .chat domain extensions. I have 2 sites that have authority 1 despite back links. Here are the details: https://oooo.dating > DA = 1 https://talk.chat > DA = 1 oooo has 221 links (Google search console) talk has 1317 links (Google search console) May be a MOZ staff member can look into this. If you are customer and use some of the newer domain extensions please share your details if you have the same problem.
Link Explorer | | dmcubed1 -
Why is moz telling me I have duplicate content, but neither the content nor the urls are duplicates?
I just upgraded our website to a new one. This is the first crawl of the new website. It is telling me I have 24 Critical issues, all of which are duplicate content errors. Thing is, the urls are not duplicates and the content on the page is not duplicated either. Example, here is one error where it says there are two duplicates: <colgroup><col width="595"></colgroup>
Link Explorer | | damon1212
| http://winterguardtarps.com/portfolio-item/props-10 |
| http://winterguardtarps.com/portfolio-item/props-2 |
| http://winterguardtarps.com/portfolio-item/props-7 | There are photos in our portfolio, and none of them are the same. I'm a bit of a noob, but what am I missing here?0 -
804 error preventing website being crawled
Hi For both subdomains https://us.sagepub.com and https://uk.sagepub.com crawling is being prevented by a 804 error. I can't see any reason why this should be so as all content is served through https. Thanks
Link Explorer | | philmoorse0 -
Learn how to use Moz's Link Intersect tool to build your link profile. Get your Daily SEO Fix!
The quantity and (more importantly) quality of backlinks to your website make up your link profile; one of the most important elements in SEO and an incredibly important factor in search engine rankings. In today's Daily SEO Fix, How to Use Link Intersect to Build Your Link Profile, Tori shows you how to use Moz's Link Intersect tool to analyze the competitions' backlinks plus, find opportunities to build links and strengthen your own link profile. This video is one of our last videos in The Moz Daily SEO Fix tutorial series--Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, make sure to visit the Daily SEO Fix channel on YouTube. And, if you have suggestions for future tutorials, please let us know via the comments below. Thanks!
Link Explorer | | kellyjcoop2 -
Why Moz Doesn't See or Count Our Backlinks?
Hi Moz Community! We have been working hard to improve our Moz metrics, measuring against a high ranking competitor to help us set our goals. Our Majestic and Webmaster Tools find tens of thousands of external backlinks pointing to our domain. That's all well and good. Moz's Open Site Explorer, however, only finds 900 total links - including internal links! This being the case, we have worked diligently to build a variety of great external backlinks, creating Bitly links and encouraging clicks on those through social promotion. Yet, our competitor has over 7,000 external backlinks in Moz's index, while ours is not growing relative to their number of backlinks. Can anyone share with us what they do to tell Moz about their backlinks? We already know we have many more backlinks than our competitor, from trusted domains with good authority, yet it seems Moz is not discovering them. We just want to understand how to use these Moz metrics to create meaningful calls-to-action. Otherwise, it seems like a gargantuan waste of time, and our team has difficulty getting buy-in from our company to put time and assets toward tasks based on our Moz numbers!
Link Explorer | | RegistrarCorp0