Drastic Monthly Fluctuations in Page Link Metrics
-
We have experienced very drastic changes in our root domain numbers and as a result, have seen an odd impact on our DA. The data does not seem at all reliable at all. We went one month with over 50 recorded root domains and the next month that dropped over 75%.
It doesn't make sense to be paying for a monthly pro account when the data is so clearly unreliable. What is going on? Looking for a good answer before closing our account!
-
Hi Nima
Google will always show more links than our crawler as they are a much larger company and have multiple seeds to crawl more pages. You should use multiple tools to obtain a full link profile which is something I've seen recommended many times in our community. The 68 links we found mean those links meet the criteria we are measuring to discover them. This also means the 158 other links may not be considered as high ranking sites or your links are too deep for us to crawl or they have been crawled and are just waiting to appear in a future index update. No single index will be the same as each company crawls differently.
As I mentioned earlier:
- We grab the most recent index
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Google does not crawl this way. This and our metrics are proprietary to Moz so it isn't that our data is unreliable or is being crawled incorrectly.
The domain authority is effected by a lot of things. It is hard to pin point it without being a SEO consultant or the specific web designer on your website. Domain and Page Authority scores are both calculated using Moz's Ranking Models work. In essence, we take a lot of rankings data from the search engines (by running queries) and then try to build a predictive scoring system using our own on-page analyses and Mozscape link data to construct an algorithm that will effectively reproduce the search engines' results. Our current accuracy hovers in the 70% range, but over time, we expect to improve.
Once we have a ranking model (which we internally call "uber"), we can create scores that best approximate the combinations of all our page-specific link metrics or domain-specific link metrics (removing the keyword-specific features like anchor text, on-page keyword usage, etc). These scores represent the model's query-independent or non-keyword-based ranking inputs.
In simple terms, Domain Authority is our best prediction about how content would perform in search engine rankings on one site vs. another. Page Authority answers the same question for an individual page. Both are amalgamations of all the link metrics (number of links, linking root domains, mozRank, mozTrust, etc.) we have into a single, predictive score.
It's important to note that both Domain Authority and Page Authority are on a 100-point, logarithmic scale. Thus, it's much more difficult to grow your score from 70 to 80 than it would be to grow from 20 to 30.
Here's some places to really delve into what is going on:
http://moz.com/blog/whiteboard-friday-domain-trust-authority
http://moz.com/blog/googles-algorithm-pretty-charts-math-stuff
http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metricsHere are some good resources to help you take a look at the factors.
http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metrics
http://apiwiki.seomoz.org/w/page/20902104/Domain Authority
http://moz.com/blog/whiteboard-friday-domain-trust-authorityI would recommend starting a new thread on the forum to seek advice from other marketers as I am only able to explain how our tools work from the technical side.
Hope this helps!
-
BTW on our webmaster tools we have 226 linking root domains. on moz we have 68.
our consistent drop in DA seems to be a factor of Moz not crawling properly. I remember back in the day the discrepancy between WMT and moz was less.
Can you please shed some light? we use moz primarily as a performance measurement software (if it can be called that), but if the data is unreliable that will make it difficult for us to do that.
I am still looking forward to your trouble shooting advice.
Kind regards,
Nima
-
thank you very much, but the answer is so technical that it does not allow me to understand much. The interesting thing from our perspective is that we had barely any links from above DA sites 70 before and we had 31 DA and now we have a lot of links from DA sites above 70 and we actually dropped.
When we posted this question, suddenly within a day many of our links appeared on your tracking system. This may indicate something happening on your end as a result of us posting this question. Many links are still missing, inlcuding one link from inc.com, which is odd.
I have also seen many sporadic changes at times in the way your metrics evaluates us. It makes it difficult to use your data for anything.
two questions that arise from the minimal amount i understood:
1- inc.com is a very high DA site, why is this link not indexed yet? http://www.inc.com/jessica-stillman/5-weird-ways-to-de-stress.html
2- why did a large number of our links get detected right after we posted this question?
thank you very much in advance,
Nima
-
Hello!
Sorry to hear your metrics have fallen. While I can't provide any consulting advice I can clarify how we index sites for Mozscape.
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index.
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://moz.com/products/api/updates
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
The index is based on freshness so domains with higher page/domain authority tend to be re-indexed each month but lower ranked pages can fall off or not be re-crawled if there are not consistently new links being built on high quality sites. We never re-crawl the same sites each index unless strong links take us to your site. It starts over completely from scratch.
Hope this helps and I will set this as a discussion so other community members can offer any advice.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer?
Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer. What is the cause of this? We've checked the robots.txt and htaccess file, but so far we can't find anything that would be blocking Moz from crawling the internal links. We manage loads of other clients on this platform and this is the first time we've run into this issue. What else can I check?
Link Explorer | | OozleMedia0 -
Pagination & Duplicate Page Title
I was under the impression that pagination resolved duplicate page title issues with Google, but Moz is flagging them up as duplicates. Is this just a case of Moz not being able to understand pagination or am I missing something? i.e. correctly formatted pagination: http://thespacecollective.com/space-memorabilia/page/4
Link Explorer | | moon-boots1 -
If for few links the spam score is not discovered, then what is the possibility of risks for those links?
For one of the links, I was checking the domain authority and spam score for which the domain authority was 65 and spam score was not discovered. In such links how do I assume or what are the chances of risks with these links?
Link Explorer | | Sneha.chandan0 -
Just Discovered Links Are Down for ~2-3 Days
UPDATE 12/01/15: This issue is now resolved and Just Discovered Link data is back. Sadly, I've got bad news. Due to an error we made (literally a typo on a curl command), Just Discovered Links in Open Site Explorer will be unavailable for 2-3 days. The data was actually lost, but we're re-indexing all those links now and they should be back in working order by Monday. NOTE: this only affects link counts and links listed in the "Just Discovered" sections of OSE. No links in the main index nor any metrics (PA/DA/etc) are affected. Our sincere apologies - we're going to build mechanisms to prevent this for the future.
Link Explorer | | randfish3 -
Open Site Explorer metrics report says we have 9 linking root domains, but way more than 7 are listen. What gives?
When I run a report on my website in OSE (SelectAccount" metrics tells me we have 7 "established" root domains and 9 total links. But the detailed report below has many dozens of links. What is metrics telling me?
Link Explorer | | SelectAccount0 -
Just Discovered links - How long before they are counted toward the PA scores
I have a new website I put up in the last 90 days. I have been watching the DA, PA and Keyword rankings. Once I set up the campaign I got a report back a week later and some data showing some keyword rankings and some DA & PA scores and links showing from 2 domains. Since this time OSE has Just Discovered 16 more backlinking domains - however the DA and PA scores have not changed ? How long after the new Just Discovered backlinks before they affect the scores I am seeing for my DA & PA ? Thank you in advance for any insight on this matter, Happy Holidays - Joe
Link Explorer | | jlane90 -
Why do links from UCAS to London South Bank University not get reported as external links
Links on the following page at UCAS http://search.ucas.com/provider/1504/london-south-bank-university?Vac=1&AvailableIn=2015&ProviderQuery=london south bank university&ret=providers do not appear to be listed as external links in Open Site Explorer reports. For example there is a link on the UCAS page to http://www.lsbu.ac.uk/schools-departments . But when I check the Open Site Explorer report for http://www.lsbu.ac.uk/schools-departments no link from UCAS is recorded.
Link Explorer | | southbankuni0 -
Why Moz doesn't offer tool similar like SEOprofiler Link Disinfection?
Hi Moz, As I have been your member & using pro tool for more than an year, it's been amazing experience working and using your each tool's function tool, wehther to check on-page grader, rank tracking, on-page crawling issue, keyword difficulty and the one my best for link analysis is Open Site Explorer etc. I came here to ask about something which I didn't find here than other providers is most popular Bad Link Detection Tool. As **SEOprofiler Link Disinfection **offers their customers to use this to get all of their bad or spammy links harming them to rank high or getting away from ranking goal. Let me know, are you planning anything similar to this to bring soon in your tools and provide your members to take benefits of such type function as well OR should i go to SEOprofiler for this? Best,
Link Explorer | | Futura
Teginder Ravi0