When will Dotbot see changes to my robots.txt file?
-
Dotbot doesn't want to know anything about my site, my Page Authotize is still 1 and my DA is the same. How long does it take to start getting results? In all the websites we have been working on, we have no problems, but in ours it has come up.
-
Thank you very much for your response, the truth is that we are appearing in different advertising media, and google has the links indexed. In fact we have now added the url to our moz profile and added it to the Link Tracking Lists tool.
It will be a matter of time
-
Hi - thanks for contacting us,
When you see a DA of 1, this will usually mean that we haven't indexed that site yet or we haven't found any inbound links for that particular site. That can happen for a number of reasons, such as we haven't found any external links to the site or the site is blocking our crawler or the site is fairly new.
When we compile our index by first crawling the more valuable pages we find and moving on from there. Specific pages may not be crawled if they have lower quality links on them or appear to be part of an unintentional link farm (for example, things like programmed calendars). If you’re wondering why we’re not identifying links to your site, I would suggest checking to make sure we’ve indexed the sites and pages you know are linking to your site.
Also, it’s important to keep in mind that with Link Explorer, new data is added all the time, so please keep an eye out for new data to be available for your site!
I hope this helps - please let me know if you have any other questions!
-
Hi there,
You just need to wait for a little bit longer, so Moz can crawl your site. Meanwhile, you check all your links in Google Search Console.
Ross
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I change the Link Explorer from check with Google US?
I'm trying to check the ranking keywords for a specific article with the Link Explorer, but when I hover over Ranking Keywords on the Overview it tells me that it's looking on Google US. We're a UK based company and the keywords we're trying to rank for are UK based - is there a way of changing this to match?
Link Explorer | | Kestra0 -
Will Moz move DA from an old domain to the new?
Hi folks, I'm moving a digital magazine of mine, which has a great deal of authority (DA53!) to a new domain, which is much more brandable. I'm curious if Moz ever passes the actual DA/PA numbers to the new domain. Does the tool pick this up, eventually? I know once the domain is switched, DA will show a "1" -- as the domain is brand new, technically. This is NOT a question about authority/link juice being passed, but rather the numbers being displayed by Open Site Explorer. Some authors do look at Moz DA as an indicator of a sites "power" before applying for authorship, so I'm trying to find a way to move to a more brandable domain, while keeping the OSE stats in place. If it's not possible, I'll have to live with it 🙂 Any input? Thanks everyone!
Link Explorer | | avilawebfirm0 -
Change in OSE?
Hi My site http://sassandgrace.co.uk has a 301 direct from the www. version as recommended and, up until last week, OSE showed no results for the www version with a message of some kind saying about the re-direct. This week the message has disappeared and I have half my links (still v small) on www version and half on the non version. Has something changed? Should I be worried? And what, if anything, should I do? Thanks
Link Explorer | | Sassandgrace0 -
Why doesn't Moz crawler follow robots.txt?
It is crawling the entire site, and there is stuff we do not want it to. Please advise.
Link Explorer | | Tylerj0 -
When Will the OSE Index Increase in Size
It's an amazing tool and the rest of Moz Pro is excellent, but the index is just so small. Does anybody know when we can expect it to increase?
Link Explorer | | Edward_Sturm0 -
When moz will index my page?
HI. I use moz pro for 1.5 month and yet my site is not indexed and i do not see Competitive Link Metrics. Can you please include meko.lv in index?
Link Explorer | | Mekounko0 -
Changed URL from HTTP to HTTPS - 99% of my backlinks don't know though
Hi Moz community, I've got a question about all old backlinks pointing to the http version of my site: Firstly, how it impacts my site's backlinks for SEO and secondly, why does Moz and if you know why Majestic have different metric report values for the different URLs. The Back Story Two months ago I bought an SSL for my personal domain and changed my URL from http to the https version. I 301'd it and can verify that on Majestic SEO using the old http URL. I did this sitewide for an eCommerce site that I'm working and did see a lift in traffic; that was the main reason based on Google talking about sites moving to the SSL Web. I'm No Stranger to 301s Of course all the URLs on my site have been 301'd. I used a HTTPS Redirect plugin for my WordPress site and there's been no issue. I also installed a 404 Checker plugin to log broken external links to my site where I can create a redirect right away in case the HTTPS plugin missed something along the way. I'm comfortable knowing that doing when you change the domain name for a site or just a page going from one URL to another will transfer all the link equity over time. What's Causing the Confusion What's a little confusing is that when I use tools like OSE or Majestic's Explorer, the data doesn't match. For instance in OSE, the https version of my domain has a DA of 1 and PA of 1. But, the http version of my site has a DA of 25 and PA of 36. With Majestic (BTW, please feel free to stop me from asking questions about another tool on Moz, but since we're all part of the same SEO community, I thought I'd ask it here anyway) the Trust and Citation flow values are definitely closely matched but still different values nonetheless. My Question Will I ever see the DA and PA the same for the https & http versions in the future? Does OSE catch the fact that there is a 301 redirect to the https version or does it only recognize that it redirects from http://kingrosales.com to http://www.kingrosales.com when in fact it redirects to https://www.kingrosales.com? My second question is, what about the backlinks? Is it because they are different URLs that OSE doesn't have a way to recognize this and display links from the old http version to the new https version? How will I know the true PA and DA of the https version of my site even with a perfectly executed 301 redirect? lol Let me know if you need more clarification. Thanks
Link Explorer | | KingRosales3 -
Rogerbot and Dotbot blocked by WP Engine hosting
We recently discovered a problem with our MOZ account which led to checking our host's settings. Turns out that WP Engine (who we love to death) automatically BLOCK Rogerbot and Dotbot from crawling sites they host. What? Yeah exactly expect I was cursing a little too. So we went through the steps of getting that sorted one bot at a time but a week on and we're still getting 403 returns via OSE. This is more of a discussion than a question expect what I would like to see is a force crawl button so that we can test that we're no longer serving a 403 error from our host MOZ. I thought WP Engine were huge and I'm surprised this has not come up before but there's no info on it anywhere. Is there a way to force a mozbots crawl??
Link Explorer | | wearehappymedia0