Drastic Monthly Fluctuations in Page Link Metrics
-
We have experienced very drastic changes in our root domain numbers and as a result, have seen an odd impact on our DA. The data does not seem at all reliable at all. We went one month with over 50 recorded root domains and the next month that dropped over 75%.
It doesn't make sense to be paying for a monthly pro account when the data is so clearly unreliable. What is going on? Looking for a good answer before closing our account!
-
Hi Nima
Google will always show more links than our crawler as they are a much larger company and have multiple seeds to crawl more pages. You should use multiple tools to obtain a full link profile which is something I've seen recommended many times in our community. The 68 links we found mean those links meet the criteria we are measuring to discover them. This also means the 158 other links may not be considered as high ranking sites or your links are too deep for us to crawl or they have been crawled and are just waiting to appear in a future index update. No single index will be the same as each company crawls differently.
As I mentioned earlier:
- We grab the most recent index
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Google does not crawl this way. This and our metrics are proprietary to Moz so it isn't that our data is unreliable or is being crawled incorrectly.
The domain authority is effected by a lot of things. It is hard to pin point it without being a SEO consultant or the specific web designer on your website. Domain and Page Authority scores are both calculated using Moz's Ranking Models work. In essence, we take a lot of rankings data from the search engines (by running queries) and then try to build a predictive scoring system using our own on-page analyses and Mozscape link data to construct an algorithm that will effectively reproduce the search engines' results. Our current accuracy hovers in the 70% range, but over time, we expect to improve.
Once we have a ranking model (which we internally call "uber"), we can create scores that best approximate the combinations of all our page-specific link metrics or domain-specific link metrics (removing the keyword-specific features like anchor text, on-page keyword usage, etc). These scores represent the model's query-independent or non-keyword-based ranking inputs.
In simple terms, Domain Authority is our best prediction about how content would perform in search engine rankings on one site vs. another. Page Authority answers the same question for an individual page. Both are amalgamations of all the link metrics (number of links, linking root domains, mozRank, mozTrust, etc.) we have into a single, predictive score.
It's important to note that both Domain Authority and Page Authority are on a 100-point, logarithmic scale. Thus, it's much more difficult to grow your score from 70 to 80 than it would be to grow from 20 to 30.
Here's some places to really delve into what is going on:
http://moz.com/blog/whiteboard-friday-domain-trust-authority
http://moz.com/blog/googles-algorithm-pretty-charts-math-stuff
http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metricsHere are some good resources to help you take a look at the factors.
http://moz.com/blog/whiteboard-friday-domain-authority-page-authority-metrics
http://apiwiki.seomoz.org/w/page/20902104/Domain Authority
http://moz.com/blog/whiteboard-friday-domain-trust-authorityI would recommend starting a new thread on the forum to seek advice from other marketers as I am only able to explain how our tools work from the technical side.
Hope this helps!
-
BTW on our webmaster tools we have 226 linking root domains. on moz we have 68.
our consistent drop in DA seems to be a factor of Moz not crawling properly. I remember back in the day the discrepancy between WMT and moz was less.
Can you please shed some light? we use moz primarily as a performance measurement software (if it can be called that), but if the data is unreliable that will make it difficult for us to do that.
I am still looking forward to your trouble shooting advice.
Kind regards,
Nima
-
thank you very much, but the answer is so technical that it does not allow me to understand much. The interesting thing from our perspective is that we had barely any links from above DA sites 70 before and we had 31 DA and now we have a lot of links from DA sites above 70 and we actually dropped.
When we posted this question, suddenly within a day many of our links appeared on your tracking system. This may indicate something happening on your end as a result of us posting this question. Many links are still missing, inlcuding one link from inc.com, which is odd.
I have also seen many sporadic changes at times in the way your metrics evaluates us. It makes it difficult to use your data for anything.
two questions that arise from the minimal amount i understood:
1- inc.com is a very high DA site, why is this link not indexed yet? http://www.inc.com/jessica-stillman/5-weird-ways-to-de-stress.html
2- why did a large number of our links get detected right after we posted this question?
thank you very much in advance,
Nima
-
Hello!
Sorry to hear your metrics have fallen. While I can't provide any consulting advice I can clarify how we index sites for Mozscape.
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index.
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://moz.com/products/api/updates
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
The index is based on freshness so domains with higher page/domain authority tend to be re-indexed each month but lower ranked pages can fall off or not be re-crawled if there are not consistently new links being built on high quality sites. We never re-crawl the same sites each index unless strong links take us to your site. It starts over completely from scratch.
Hope this helps and I will set this as a discussion so other community members can offer any advice.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Links to non-exisiting pages
Hi, I have tons of incoming links to target pages on my website that do not exist. If you follow the link you get a 404 error. The anchor text is always a "spammy" non related text. Does anyone know what is happening and how to get rid or block these links? Thanks, Dirk
Link Explorer | | FoodJEt0 -
Domain Authority (DA) in Moz Pro changed only within the last 1-2 months?
Has anyone noticed that the Domain Authority (DA) as reported in Moz Pro has changed only within the last 1-2 months? We have screen shots showing plots of DA vs competitors w/ line graph 2 months ago starting in NOV 2017 which today starting JAN 2018 and comparing shows DA up to 50% different!
Link Explorer | | Amplitude_Digital
The change is seen both in the Links Overview and under the Spam Score sections still marked "NEW". Can Moz confirm that it's only recently within the last 2 months that in Moz Pro the NEW DA numbers have retroactively been updated even though the new Link Explorer has been publicly out since APR 30 from https://moz.com/community/q/moz-s-new-link-explorer-including-our-revamped-index-and-da-pa-scores-is-now-open-to-everyone? Look at the top green line starting ~12 months ago on both graphs, w/ old below 40 and new above 50. We've seen even greater differences for other tracked domains. Thanks! view0 -
How can I get links indexed in Just Discovered Links, or Open site Explorer? (Because it aint Bit.ly or Feedly!)
Dear Moz & Forum, I've been on a bit of a merry-go-round with one of my clients. He knows enough about SEO to ask questions, and one thing he likes is to see the links that we are building inside Open Site Explorer. Now, of course we know that it takes a while for links to show, but that was ok, because we could just plug the links that we've built into a bit.ly link and then they'd show under Just Discovered Links in Open Site Explorer, and then boom, we're happy. It stopped working some time ago, and after the support team were a little unstuck I sent a hopeful tweet to @randfish. Here is the response: https://twitter.com/randfish/status/788412272129347584 The advice to use Bit.Ly was removed swiftly after this! Oops! The current Guidance is here: https://moz.com/help/guides/research-tools/open-site-explorer/justdiscovered It says: Want to see your new link in the Just-Discovered Links tab? An easy way to start seeing your link in the Just-Discovered section is to have it shared on Twitter and available on Feedly link. Feedly stopped supporting their own link shortner a few years ago. Also, when you share a link from Feedly on twitter it is just the same as sharing a normal tweet, because it shares the standard URL for the site not a link to view on Feedly. Or, maybe these two statements are independant of one another and they should both be done separately? I've done that too! I've also added the feed to recommended feeds inside fresh web explorer and that didn't work either! So, Moz and Help team please help me! How can I get links I've built for clients into Just Discovered Links? Thank you!
Link Explorer | | stevestretton11 -
Pagination & Duplicate Page Title
I was under the impression that pagination resolved duplicate page title issues with Google, but Moz is flagging them up as duplicates. Is this just a case of Moz not being able to understand pagination or am I missing something? i.e. correctly formatted pagination: http://thespacecollective.com/space-memorabilia/page/4
Link Explorer | | moon-boots1 -
Learn how to use Open Site Explorer's Top Pages report to help inform your content marketing efforts. Get your Daily SEO Fix!
With the Top Pages report, you can see the pages on your site (and your competitors’) that are top performers. The pages are sorted by Page Authority - a prediction of how well a specific page will rank in search engines - and also metrics for linking root domains, inbound links, HTTP status and social shares. Be sure to watch today's Daily SEO Fix video tutorial to learn how to use Open Site Explorer's Top Pages report to analyze the competitions' content marketing efforts and to inform your own. This video is part of The Moz Daily SEO Fix tutorial series--Moz tool tips and tricks in under 2 minutes. To watch all of our videos so far, and to subscribe to future ones, make sure to visit the Daily SEO Fix channel on YouTube.
Link Explorer | | kellyjcoop3 -
Open Site Explorer metrics report says we have 9 linking root domains, but way more than 7 are listen. What gives?
When I run a report on my website in OSE (SelectAccount" metrics tells me we have 7 "established" root domains and 9 total links. But the detailed report below has many dozens of links. What is metrics telling me?
Link Explorer | | SelectAccount0 -
Confused about the link metrics showing up in MOZ & OSE
For my campaign "itelligence Applications" which is for site itelligencegroup.com/uk/ - MOZ seems to be giving me different stats on links, depending on which tab I look it in the Link Analysis section. Then when I look at OSE, the numbers are totally different again, not just a little bit different. Example: In MOZ Link Analysis, on the "inbound links" tab, it says there are 129 Root Domains and 6832 Total External Inbound Links. If I then look at the Competitive Metrics screen, it says there are 46,284 external followed links and 240 total linking root domains. If I then go to OSE for the same site, it says there are 14 Root Domains and 686 total links. I have no idea why these numbers vary so much or how to even report them to my client. Am I missing something here? Any help would be gratefully received! Maureen
Link Explorer | | mfrgolfgti0 -
Inbound Links Sorted by Linking Domain
Hi All -- Does anyone know if it is possible to generate a report (or is there a setting) to have the OSE inbound links report sorted by OSE linking domain? Ideally, the report would create a second column in the "Inbound Links" report with "Linking Domain" and then you could create a nice report that cross-tabbed the links. While you could do some excel text manipulation to do this, does anyone know if it's possible to do through the report generator? Thanks, Matt
Link Explorer | | Resolution_Rentals0