Hey everyone!

Depending on when we discover your links on those external sites, it can take 2-3 index updates for them to appear.

There are two types of link data we capture: External and Internal Linking pages. In order for us to discover backlinks to your site, we need to crawl the sites and pages linking to you that have high authority. Once we can find those links, we will then be able to crawl your site to find pages you link to and so forth.

Here's how we compile our index:

• We grab the most recent index.
• We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
• We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).

Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Check the Just Discovered Links section to see if your link is processing. Links that appear there can take 1-2 updates to show up in inbound links.

Other tools, such as Webmaster Tools, Ahrefs, and Majestic will alway show more link data as they target the quantity of links, while OSE focuses more on quality and Domain Authority (our metric). It’s best to use all the tools you can to obtain a full backlink profile.

Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these. Run a search for those external linking sites and check their domain authority, if it isn't high enough we may not have a reason to re-crawl them to find your new links.

Hi Massimo!

Currently multi-access will not be ready until early next year. You can have your account automatically send weekly or monthly custom reports to any email address so you are not forwarding them manually. If they need direct access to their campaigns, the only way would be to share your login which would not be ideal as they would also see data for other clients. Multi-access will solve this. This is a top priority feature and is in the final design stages.

Hope this helps!

Hi Doron

Donford provided some great advice. Also when adding new pages to track, you will have to wait for the next weekly update before your report is automatically generated. Hope this helps.

Hi David

Sorry to hear your metrics have not moved. Usually if you do not see a change in your DA, it means we haven't discovered new links from high authority sites. Just so you know, here's how we compile our index:

• We grab the most recent index.
• We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
• We start crawling from the top down until we've crawled 90,000,000,000 pages (which is about 35% the amount in Google's index).

Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index.

Other tools, such as Webmaster Tools, Ahrefs, and Majestic will alway show more link data as they target the quantity of links, while OSE focuses more on quality and Domain Authority. It’s best to use all the tools you can to obtain a full backlink profile.

Keep in mind you do not have to have a paid subscription for us to crawl your links. We are crawling constantly and your subscription only unlocked more reporting options and access to see more data. You can monitor your DA without a subscription for free.

What you can do is search the sites you are building your links on. Look at their domain authority and see if they are considered to be influential for your links. If you are not building new links and growing the amount of linking root domains, then you will not see any change of your DA. Compare your site with your competitors, look for the # of linking root domains, # of linking C blocks, and total links. Take a look at the DA of their linking root domains and see if you can build your links to those sites as well. The more, the better!

For Moz Local. I was able to force the update to change the number. This has now been submitted.

Hope this helps and let me know if you have any questions!

Hey everyone thanks for the heads up! We've notified our devs to get the links fixed.  

Hello!

I'm sorry to hear you are experiencing issues with Mozbar.

We recently upgraded the MozBar and we're receiving reports that some users are unable to view certain metrics within the tool. I can confirm this issue is not on your end as this affects my access as well. Our engineers are investigating a solution and once a fix has been deployed I will definitely let you know!

Hi Lee!

To set those hours, you would add the day twice where 1 will cover the 4pm-12am slot and one for 12am-1am as shown here: https://www.evernote.com/l/AQ2c8WfJN2RJ9oe2CdF2oCgr6JCFlkgKtMg

Hope this helps!

Hi Andreas

You may have better luck over on the dev forum at http://seomoz.zendesk.com/forums/293196-developer-discussion-group

We prefer all API related questions to be posted there.

Hope this helps!

Hi Dimitri,

Thank you for the feedback! I can confirm that we are experiencing a bug with completing profiles which we hope to resolve soon. Some footers will still show SEOMoz as it is still our legal name. We are currently updating SEOmoz to Moz for the forms you mentioned.

I will shoot an message to our devs to see if they can add a link to moz.com from the devblog.

As for your profile, I cannot duplicate the issue. If it occurs can you post a screenshot?

Thank you again and feel free to reply with any other issues!

Cheers

Hi Tim!

We spoke on Friday over the phone and chat. Extimaseo provided the exact steps you would need to cancel your account. If you decide to sign back up in the future all of your historical data will remain with us so you will be able to re-activate them at any time. I'm very sorry to hear you are leaving us. When viewing your subscription page, the cancel link is located here: http://www.screencast.com/t/f22pEtuD1

Hope this helps.

Hi Josh

When exporting a report or looking through the backlinks via paginating, OSE will only show you up to 25 links per linking domain so not all links will appear. I believe Majestic's and Ahrefs who are more backlink focuses has tools that may show more backlinks than we do.

Hope this helps!

Hey Philip

Currently we would need a physical address in order to validate against Facebook Places or Google+. You can setup an address in one of them to validate and publish then set your info to be hidden or private afterwards. By marking your business type as a home business in the csv file will allow our partners to hide your address.

Hope this helps!

UPDATE: Only one partner can hide the address, all others will display the full NAP and in order for us to stay connected to a validating source (google/facebook) the listing must not be setup as an SAB. Google now hides SAB listings from their Places API.

Service Area Businesses are not supported and it is recommended to manage your listings manually: http://www.localvisibilitysystem.com/2013/04/22/private-local-citations-where-can-you-list-your-business-but-hide-your-address/

Hi Everyone

The weekly delays and the smaller Index are completely separate, but importing the index data into Moz campaigns are affected. A smaller index was necessary for us to release it without further delay. This release has 187 billion links instead of what we originally had planned which possibly between 250-300 billion links. We hope our next index will be intact and released on schedule.

Here are the index details: https://moz.com/products/api/updates

Hi Micha

From the support side we can't do much on our end but our product team does have a forum we encourage posting on to submit ideas and feature requests. The link to the forum is here: https://seomoz.zendesk.com/forums/293194-seomoz-pro-feature-requests

This is the only way for us to prioritize and plan enhancements and feature requests outside of bugs so definitely submit your suggestions there.

Hope this helps!

Your robots.txt is blocking us with the wildcard directive at the very bottom.

You will want to add:

User-agent: dotbot
Disallow:

This should update when we release a new index next month.

Hope this helps!

Hi Cole!

It takes our partners about 8 weeks to process the data. We don't have control over this but if the updates are not reflected past 8 weeks, definitely let us know at help@moz.com so we can check with them for status.

Hi Lehia

Crawl reports are separate from our Mozscape indexes. Also any delays with our index only impact the ability to access new data. With your crawl reports I have a suspicion the URLs with the 404s are ones with trailing slashes e.g. domain.com/ and not domain.com

If not, send us your account info and some examples at help@moz.com and we can take a look!

Hey Dan!

We import daily traffic every 48 hours for social data. Toggle to the daily view as the default weekly view will not have any data until a full week's worth is collected.

Hope this helps!

Hello!

Your site has too many re-directs setup which will prevent our crawler from reaching more pages.

Your campaign is setup to crawl the sub-folder www.automationanywhere.com/Testing

which re-directs to http://www.automationanywhere.com/testing (301) which then re-directs to https://www.automationanywhere.com/testing/ (303)

You will need to update the re-direct to be a 301 and re-create the campaign to track www.automationanywhere.com/testing/ with the lowercase sub-folder name.

For OSE it may take a few index updates to catch up and the previous URL had low authority to begin with so to help get index you will need to continue to build strong backlinks on sites with high Mozrank. With our site ourselves having high DA it took about 3 months for our links to be moved over from seomoz.org to moz.com

Hi rosemontmedia

The check listing tool is a search tool, so it will rely on the response Facebook and Hotfrog provides when we are querying for the business information. Each time you generate a listing report, this is a live query. If no results are found, this means the data is not available in their respective API's. Hotfrog doesn't have the best API as many listings fail to appear in our searches. For Facebook, you will want to make sure their listing is setup as a local business page and has a couple of check-ins in order for the information to be available.

Hope this helps!

Hello!

Domain Authority is OUR metric and we have a specific way of crawling to calculate our metrics. Majestic will have their own link discovery methods as well as other backlink tools. You will not find the same amount of data with any single tool so it is best to use all at your disposal to have as much information as you can for your analysis.

Hope this helps!

Hi Ana

You can find your crawl diagnostics under Search > Crawl Diagnostics from the left sidebar.

Hope this helps and check out our help guide for more info: http://moz.com/help/guides/search-overview/crawl-diagnostics

Cheers!

Hi Thomas

Do you have any filters setup in your Google profile? Any filters enabled will prevent Google from sending us you search traffic data.

As for backlinks we have a specific way of indexing links we discover from internal sites.

Here is a our guide that explains more about the process: https://moz.com/help/guides/research-tools/open-site-explorer#frequently-asked-questions

Hi Radi

Just wanted to add that dotbot only crawls once a month while rogerbot crawls weekly. So you will not see any new metrics on OSE until we update our next Index.

Hi Darren!

We do have walkthroughs that can help guide you through your setup at the link Keszi provided. We also have a live welcome webinar hosted by our Success Team each week. You can register here: http://moz.com/help/guides/getting-started/welcome-webinar

As far as correct settings go, we can only verify your campaign URL is setup the way you want it to, the other settings will be up to you to confirm.

For example if you want to track all pages within a domain, then setup a root domain URL as domain.com, this will track all pages and sub-folders for the entire site.

If you only want to track the root domain, or only a sub-domain or sub-folder. Then you would check the box in the advanced settings to "exclude all sub-domains" and you would put www.domain.com or www.domain.com/folder/

This means we would only look for rankings for that specific URL.

For competitors, we can only track the specific URL set. If they appear on Google as www.domain.com, then make sure to add them with the sub-domain.

I highly recommend signing up for the webinar as it is the only way we can provide live walkthroughs of our tools. Hopefully the other resources can help as well!

Hi Rena

The links are a result of missing the proper mailto: tag when linking an email address. In the source code you will want to look for [sales@intercallsystems.com](<a class=)">

and replace it with <a <="" span="">href="mailto:</a>sales@intercallsystems.com">

Hope this helps!

Hi Endre

Sorry for any confusion. Our index can show you data cached for up to 190 days. These are links that we followed at least over 6 months ago. They will fall out of our index with the next couple of updates.

Hope this helps

Hello!

I can confirm your site does use SNI which can be checked at https://globalsign.ssllabs.com/analyze.html?d=www.honesthouse.co.uk&latest

If anyone else is unsure about your own site, you can use the above link, replace the URL and click on any server results which will confirm SNI status shown here: http://www.screencast.com/t/GLzjD7gjzjR

As for any workaround, other than disabling SNI completely, the quickest option to get crawled would be to sign up for the beta.

Jon will keep everyone posted with any new status and I can assure you this is our top priority feature we are working on.

Hi Guys

Moz.com is treated the same way as other sites. It could take 2-3 index updates for our crawls to go through all community profile pages to update metrics. For Jamie, we have never crawled your profile page so where your profile exists on the site might be too deep for us to find. Try to remember that OSE crawls for fresh and diverse links. We aren't big enough yet to crawl all pages on every site so the more links you have to a specific page from other external sites can help.

Hope this helps!

Hey there!

Daily traffic will start appearing after 24 hours. View Search > Traffic from search and change the timeframe to Daily. Once a week has been collected, weekly data will appear in the default view (weekly).

Hope this helps!

Hey Torbett!

Keywords in Moz Analytics are case-sensitive, this includes Rank Tracker as well.

Hope this helps!

Hello!

We do not have a hashtag tracker. Overall we don't have a strong focus on Social metrics outside of Followerwonk and we're more about tweets to and from particular users rather than a larger trend analysis. If we see more interest in this, it could be something our product team could add to their roadmap.

Currently I would recommend checking out https://tagboard.com/ for hashtag analysis.

Yes the sign up link is in the very first post by Jon

The link is http://goo.gl/forms/LCvL9Ix8JDHfbAvr1

Hi Juan

We are not seeing any issues with the on-page grader. Can you share a screenshot of the error message?

Hi Etienne

I checked the campaign you have with the 902 response and the issue is with your host blocking AWS IPs. I could not find any SSL or SNI errors for the domain.

You will want to reach out to your hosting provider to make sure they are not blocking any AWS IP ranges. Our IPs are dynamic so we will not be able to provide a range for you.

There are also other issues with the SSL configuration which will need to be looked at which could result in different errors once the IPs are unblocked.

http://www.screencast.com/t/b8qEdNah

You can run a test here for any SSL domain: https://globalsign.ssllabs.com/analyze.html

Hope this helps!

Hi Ryan!

Our crawler will flag pages that have at least 90% similarity in the entire source code of the site so not just the body.

The way you want to interpret the report is the contact-us page has 35 duplicates, so "gabe" and "sale" are not dupes of each other in this section but are only each a duplicate of "contact-us". Those URLs might appear with their own duplicates of the same pages further down in the report.

While on the front end the pages do not appear to be similar. The issue is likely with the amount of javascript code on those pages.

Our crawler cannot read javascript so we are likely only able to see the template of the page. Other search tools are probably seeing the same thing as it returns 79% similarity  using this tool: http://www.freebulkseotools.com/similar-page-checker-tool.php

I can't provide much insight from a dev perspective but hope this helps!

Hi Hector!

Old links generally do not stay in our index or will get picked up unless we can discover or re-discover those links from currently crawled pages. OSE is based on freshness so we would need to discover NEW pages that are still linking to your links. If they are old links and are now too deep from the home pages of those sites, we will not likely pick them up. After each index release we start from 0 links and crawl are way down from sites with high domain authority and those seeded from these sites are generally re-crawled and discovered.

OSE = quality, webmaster tools = quanity

Hope this helps!

Hey Allison!

We did make an unexpected change due to losing access to Bing's API for their search volume. We found that Grepwords' API has access and for an emergency solution we worked out an arrangement to partner with them to restore access to Google's Search Volume, which we lost direct access to a long time ago. We are seeing some long-trail phrases return no results but are not seeing any issues, Google may not have data for those keywords.

Hope this helps!

Hi Collin

We can remove your from our list of receiving unsolicited messages but cannot disable the bubble entirely as this is our easiest way for our customers to reach out to our help team for issues.

Hope this helps

Hello!

The standard and medium plans will each have a set limit to crawl up to 50,000 pages. The higher plans have adjustable limits, 10,000, 20,000, etc.

Hope this helps

Network errors can be somewhere between us and your site and not necessarily directly with your server itself. The best bet would be to check with your ISP for any connectivity issues to your server. Since your issues are only the first time they are reported, the next crawl may be more successful.

One thing though you will want to keep your user-agent directives in a single block of code without spaces.

so

Crawlers Setup

User-agent: *

Directories

Disallow: /ajax/
Disallow: /404/
Disallow: /app/

would need to look like:

Crawlers Setup

User-agent: *

Directories

Disallow: /ajax/
Disallow: /404/
Disallow: /app/

Hi Duke!

I'm afraid square space is blocking our crawlers for some reason. Our engineers are working with their engineers for a solution. This may take some time to resolve and this is the only reason we are not able to reach your page.  

Hello!

There are two parts of our on-page grader. The discover tab which grades keywords we find ranking in the top 50 automatically and Track & Discover where you can add the URL + Keyword combo we will automatically grade each week. You can set up a custom report to obtain a PDF update to email for the overview but not for individual reports.

This is only available in a Moz Campaign.

Hope this helps!

Hi Lisa!

We are already in the process of implementing SNI through writing a new crawler since we cannot simply update our existing one. This will take some time to build and I'm afraid I do not have an exact ETA for completion.

Hey Holger!

This is a great question.

One of your best options is to create separate URLs for each language as recommended by Google's documentation regarding multi-regional and multilingual sites found here:

http://support.google.com/webmasters/bin/answer.py?hl=en&answer=182192#1

example:
1. www.website.com (english) 
2. www.website.de (german)

This would be a lot of work and (potential) site restructuring so how viable this option is would be something you would need consider.

Another option is to create a subdomain for the english site (e.g. http://en.website.de). Once this is done, you can start a campaign for both website.de and en.website.de. This way you can isolate just the english version of the site.

The last option that I can think of would be to create a campaign for your main/originating domain. If the english subfolder is housed on that domain, we'll more than likely crawl it along with the rest of the site. To separate out the English and German content, you could just filter/remove it from an exported CSV report.

Regarding your suggestion for excluding folders and URLs, this would be an excellent feature request. I recommend submitting this in our feature request forum. Our Product team checks this daily and uses it to help plan out our roadmap for future releases and may add this in there.

Hope this helped clear things up and let me know if you have any other questions. Thanks!

David Lee
SEOmoz Help Team

Hey Josh!

With the latest increase of crawl limits for all campaign, unfortunately the lowest is set for 10,000. If you have less than 10,000 pages then we will only crawl the total amount of pages you have. Takeshi has great tips on excluding certain pages from being crawled in robots.txt

Our user-agent is rogerbot so an example would be

User-agent: rogerbot
Disallow: /categories/

Hope this helps!

Awesome to hear!

As for other tools to measure traffic drops we don't have any but I recommend creating a new post on the Q&A as our community may be able to provide some tips

Hello everyone!

I am super sorry you are not able to add your profiles. We are experiencing a connectivity issue with Google and our engineers are investigating the source. Once this is resolved I will let you guys know!

Thank you for your patience and I apologize for any inconvenience.

Hey Everyone!

The search volume you're looking for is pulled from Google's Adwords API. We unfortunately no longer use the AdWords API and it's unlikely that we will be getting it back. We are working on an alternative resource for that information but we have no solid time frame right now.

The data is available directly from your AdWords account as well if you need it.

That section is separate from the rest of the report so the choices you see in the drop down will not affect the volume and will always remain static on every report.

It is a little confusing and I do apologize.

Thank you!

So I took a look at your campaigns and it shows we crawled 394 pages.

http://www.screencast.com/t/bQcauoHeH27B

It's possible that your first crawl may not have picked up on the redirect but it's definitely finding pages now.

Let me know if you see something different in your settings.

Cheers,