Drastic Monthly Fluctuations in Page Link Metrics
-
We have experienced very drastic changes in our root domain numbers and as a result, have seen an odd impact on our DA. The data does not seem at all reliable at all. We went one month with over 50 recorded root domains and the next month that dropped over 75%.
It doesn't make sense to be paying for a monthly pro account when the data is so clearly unreliable. What is going on? Looking for a good answer before closing our account!
-
Hi Nima
Google will always show more links than our crawler as they are a much larger company and have multiple seeds to crawl more pages. You should use multiple tools to obtain a full link profile which is something I've seen recommended many times in our community. The 68 links we found mean those links meet the criteria we are measuring to discover them. This also means the 158 other links may not be considered as high ranking sites or your links are too deep for us to crawl or they have been crawled and are just waiting to appear in a future index update. No single index will be the same as each company crawls differently.
As I mentioned earlier:
- We grab the most recent index
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Google does not crawl this way. This and our metrics are proprietary to Moz so it isn't that our data is unreliable or is being crawled incorrectly.
The domain authority is effected by a lot of things. It is hard to pin point it without being a SEO consultant or the specific web designer on your website. Domain and Page Authority scores are both calculated using Moz's Ranking Models work. In essence, we take a lot of rankings data from the search engines (by running queries) and then try to build a predictive scoring system using our own on-page analyses and Mozscape link data to construct an algorithm that will effectively reproduce the search engines' results. Our current accuracy hovers in the 70% range, but over time, we expect to improve.
Once we have a ranking model (which we internally call "uber"), we can create scores that best approximate the combinations of all our page-specific link metrics or domain-specific link metrics (removing the keyword-specific features like anchor text, on-page keyword usage, etc). These scores represent the model's query-independent or non-keyword-based ranking inputs.
In simple terms, Domain Authority is our best prediction about how content would perform in search engine rankings on one site vs. another. Page Authority answers the same question for an individual page. Both are amalgamations of all the link metrics (number of links, linking root domains, mozRank, mozTrust, etc.) we have into a single, predictive score.
It's important to note that both Domain Authority and Page Authority are on a 100-point, logarithmic scale. Thus, it's much more difficult to grow your score from 70 to 80 than it would be to grow from 20 to 30.
Here's some places to really delve into what is going on:
http://moz.com/blog/whiteboard-friday-domain-trust-authority
http://moz.com/blog/googles-algorithm-pretty-charts-math-stuff
http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metricsHere are some good resources to help you take a look at the factors.
http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metrics
http://apiwiki.seomoz.org/w/page/20902104/Domain Authority
http://moz.com/blog/whiteboard-friday-domain-trust-authorityI would recommend starting a new thread on the forum to seek advice from other marketers as I am only able to explain how our tools work from the technical side.
Hope this helps!
-
BTW on our webmaster tools we have 226 linking root domains. on moz we have 68.
our consistent drop in DA seems to be a factor of Moz not crawling properly. I remember back in the day the discrepancy between WMT and moz was less.
Can you please shed some light? we use moz primarily as a performance measurement software (if it can be called that), but if the data is unreliable that will make it difficult for us to do that.
I am still looking forward to your trouble shooting advice.
Kind regards,
Nima
-
thank you very much, but the answer is so technical that it does not allow me to understand much. The interesting thing from our perspective is that we had barely any links from above DA sites 70 before and we had 31 DA and now we have a lot of links from DA sites above 70 and we actually dropped.
When we posted this question, suddenly within a day many of our links appeared on your tracking system. This may indicate something happening on your end as a result of us posting this question. Many links are still missing, inlcuding one link from inc.com, which is odd.
I have also seen many sporadic changes at times in the way your metrics evaluates us. It makes it difficult to use your data for anything.
two questions that arise from the minimal amount i understood:
1- inc.com is a very high DA site, why is this link not indexed yet? http://www.inc.com/jessica-stillman/5-weird-ways-to-de-stress.html
2- why did a large number of our links get detected right after we posted this question?
thank you very much in advance,
Nima
-
Hello!
Sorry to hear your metrics have fallen. While I can't provide any consulting advice I can clarify how we index sites for Mozscape.
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index.
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://moz.com/products/api/updates
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
The index is based on freshness so domains with higher page/domain authority tend to be re-indexed each month but lower ranked pages can fall off or not be re-crawled if there are not consistently new links being built on high quality sites. We never re-crawl the same sites each index unless strong links take us to your site. It starts over completely from scratch.
Hope this helps and I will set this as a discussion so other community members can offer any advice.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Link Explorer is not working for particular domain
Hello, Linking Domain section in Link Explorer is not working fine for sewingmachineprice.com. When I put this domain to analyze for backlinks it says, "You entered the URL https://sewingmachineprice.com/ which redirects to www.hugedomains.com/domain_profile.cfm?d=sewingmachineprice&e=com. Click here to analyze www.hugedomains.com/domain_profile.cfm?d=sewingmachineprice&e=com instead." In fact, this domain is not redirected to any third domain or URL. I personally checked it and can access this website without any redirection.
Link Explorer | | Jacksmorrin0 -
Why moz is not indexing link from 21 march any body knows
I have lot of website few of them are really big sites. i want to know Why moz is not indexing link from 21 march any body knows please let me. is there some kind of maintenance going on
Link Explorer | | Arenapile3210 -
Link Explorer Is not working
My Links Explorer is not working, Does anybody has the same issue? Note Also, why do I have to open an account imgur.com to upload a screenshot to fix a problem of MOZ tool Help with Moz Products & Tools on the question categories does not show the option for Link Explorer
Link Explorer | | Roman-Delcarmen2 -
Https in Top Pages Report
Our site migrated to https a year ago but when I ran the Top Pages report, it's listing only http URLs. 1. Why is it only listing http URLs? 2. I'm interested to see which ones 301 redirects to https and which are 200. How can I do this? Thanks!
Link Explorer | | CND0 -
No Competitive Link Metrics Published Since October 28th, When Are They Expected?
MOZ has not published competitive link metrics sinceOctober 28th. Does any one know when we can expect to see them published? Thanks,
Link Explorer | | Kingalan1
Alan1 -
Open Site Explorer only showing 10 internal links, and 270 external links
Hi, I run the website www.abackpackerstale.com ,and for some reasons opensite explorer is only showing 10 internal links, and a 200 and something external links. How can I fix this as I am sure it is hurting my DA authority, and overall site score. Thanks! Stephen
Link Explorer | | backpackerstephen0 -
Why do 0 back links show for my website in Open Site Explorer?
I've read and understand that all back link tools results will vary from one another but Open Site Explorer and some others find 0 linking to my site. Webmaster tools show 46 back links. Is this because they are all "no follow"? I'm trying to get a grip on SEO but am very confused from the get go. Thanks, Todd
Link Explorer | | Grateful_Monk0