Welcome to the Q&A Forum

Hi there! Sorry to hear you're having trouble.

Our crawl error guide is a great place to start to find more information. You might consider running a Crawl Test on the site to validate the error, as it could possibly have been a temporary issue. If you're still seeing the error crop up, it probably warrants additional investigation.

Usually a 5XX error means an issue on your server, so you might wish to inquire with your web dev about the cause. If you're still not sure what to do, the Q&A forum is generally a great place to look for ideas in resolving some of these issues. Here are some articles that might help:

https://moz.com/community/q/issue-5xx-server-error

https://moz.com/community/q/thousands-of-503-errors

Hello there!

When you first create your campaign, we perform a rush collection to gather data for your site. Generally you'll start to see this information come through within 24 to 48 hours of campaign creation. You can check out the Rankings tab of your campaign to see if they've arrived!

However, if you added new keywords after the initial creation of your campaign, they will not be included in this rush collection and you will need to wait until your next weekly crawl to see results. It's difficult to tell which case this is without looking at the campaign, but if you have additional questions please contact us at help@moz.com to take a look!

Hey Susannah!

Moz's crawler is built to be more sensitive to crawl issues than Google's crawler as we feel it's better to provide more data than less. If you're wondering what's causing certain crawl errors to pop up you can always check out our Crawl Errors Guide. It's hard to know what's causing your 403 errors without looking at the site and campaign, but if you'd like help in diagnosing the issue I recommend writing in to help@moz.com with your details so we can check it out!

Hey there!

While Moz Pro doesn't display keyword rankings in custom timeframes, you can access your historical keyword data by heading to the Rankings section of your campaign, scrolling down to the Tracked Keyword Overview, and hitting the 'Rankings History CSV' button. That will send you a CSV of all your keyword ranking data from the beginning of your campaign! You can then use that data to construct reports for custom timeframes.

I hope that helps!

Generally we expect listing update on our partner directory sites within 8 to 12 weeks. Moz Local focuses on updating your listing with Factual, Foursquare, Neustar/Localeze, Infogroup, Best of the Web, Acxiom, Citysearch, CityGrid, Bing and Superpages.

You can update your listing information with our non-partner sites at any time you like! Moz Local will monitor places like YP, Yelp, Hotfrog, Google, and Facebook on your behalf to help identify duplicates and inconsistencies.

I hope that helps!

Hey there! Sorry to hear you're seeing mixed information in your emails.

Unfortunately this is hard to diagnose without taking a closer look at the report email and campaign in question. We'd be happy to take a look and help you sort it out if you email the Help team at help@moz.com with the details of your account!

Hey there! Thanks for the question.

Our link index updates about once a month, and while it is large it does not cover the entire web.

Most new sites and links will be indexed within 60 days, but some take even longer for a variety of reasons, including the crawl-ability of sites, the amount and quality of inbound links to them, and the depth of pages in subdirectories. We run on a breadth-first approach, starting at the top of a site's hierarchy and moving down from there, so it's less likely that pages deeper in the site will be present.

You can check to see if we have indexed an individual page on your site by entering the URL into Open Site Explorer. We do recommend using a multitude of sources to get the best idea of your overall backlink profile, including internal links.

Let us know if there's anything else we can help with!

Hey Jamie! Sorry to hear about your frustration with the Google Analytics feature. I can definitely understand why this would be a pain point for you. While we don't offer a search function for Google Analytics profiles at this time, I'm happy to give this feedback to our product team! Thank you for bringing it to our attention!

Hi there Eric!

The Yellowpages listing we are associating with your Moz Local listing is simply a best-match search for that site. Often this means we're not seeing a better match in the Yellowpages backend at that time. This can happen for a number of reasons, including the page not being available in the Yellowpages API, or updates not yet taking affect in their backend. We're constantly listening for matches on that site, so your best bet is make sure the YP listing matches your Moz listing exactly. Unfortunately, since we're not directly partnered with YP, there's not much we can do to force the listing to surface from our end. If you know it's correct but we can't pick it up, the only real downside is a slight ding to your listing score.

I hope that clarifies things!

Hi there! Sorry for the trouble.

I checked on your account and it looks like it was already refunded by one of our team members. You should have received a follow up email about that.

Please let us know if you have any other questions!

Hi there!

Sorry for any confusion. If you're seeing odd URLs show up in your Top Pages report within Link Explorer or the Links section of your campaign, it is because we found a link out in the internet that leads to that page. It is entirely possible that whichever site it is coming from has an incorrect or inaccurate URL for your site. We could definitely help take a look at this if you email in the campaign details to help@moz.com! Thanks.

Hi there Cathleen!

Moz Local actually automatically pushes out your listing information to our directory partners on a continual basis! That means if you make any changes to your listing, the tool takes care of all resubmissions on your behalf.

I hope that helps!

Hi there!

It's difficult to answer this question without know how your campaigns are currently set up and the exact domain of the new sites areas. Generally speaking, if you're tracking a domain in a campaign and are not restricting the crawl to a specific subdomain or subfolder, we will crawl all pages accessible on that site as long as we can find links to those pages. If you're having the domain redirect to an entirely new domain, that may cause more complications as the new site could be seen as out of scope. If you want us to take a closer look at the situation and your existing campaigns, please reach out to us at help@moz.com.

Hi there!

Right now we don't offer a way to view metrics for multiple countries simultaneously, but I am happy to pass along this request to our product team. If we offered this option it would likely still eat up a separate query credit per country, however. Please let us know if you have any other feedback about the tool!

Hi Brandon! Sorry to hear you're having trouble setting up your campaign.

There are a number of reasons the subdomain in question might be inaccessible. It's possible the crawler is being blocked on a server level, or that AWS is blocked, or that the page is returning another sort of server/client error. We're happy to help diagnose this if you write into help@moz.com with details about the specific domain you're trying to enter!

Sorry for the trouble! There are a few specific details that need to be present on those listings in order for us to appropriately detect and match them to your Moz Local data. Here is list of the criteria for those sources that will enable us to validate your listing:

• The name, address, and phone number (NAP) listed on the page must be an exact match with the listing in Moz Local.
• The primary phone number listed must be a unique local number or a toll-free number.
• The primary page category must be “local business”.
• A minimum of 2 visitor check-ins are required. Not sure what to do here? Head to Facebook's resources to see how to let people check in and how you can check in.
• The page must be fully accessible to all potential visitors, so any restrictions based on age, location, etc. must be disabled. This can be easily checked by attempting to view the Facebook page in a Chrome incognito browser while not logged into a Facebook account; if you can view the page normally in these conditions, the accessibility should be in good shape!

If you're still unable to determine why we're not picking it up, feel free to write in to help@moz.com and we'll be happy to investigate.

Hey there! Unfortunately there is not currently a way to mark links as disavowed in Moz tools. Generally Spam Score should be used a guideline to investigate potential penalization issues rather than a concrete checklist. If you know that you've worked on your harmful backlinks, you can usually ignore that warning!

Learn more about Spam score with the following articles:

Spam Score: Moz's New Metric to Measure Penalization Risk

Understanding and Applying Moz's Spam Score Metric - Whiteboard Friday

Hey there! While our keyword corpus for Keyword Explorer is large, it does not cover all keywords. If you see "no data" reported for a keyword's volume, it means we do not yet have volume information available. The good news is that your Keyword Difficulty score is unaffected by volume data, as it relies on SERP rankings, so you can definitely still find useful data! We are continually adding keyword volumes to our database, so we may have data for these keywords in the future. I hope that helps clarify things.

Hi there!

We have a few resources that can help get you started on your SEO journey.

Beginner's Guide to SEO

The SEO Learning Center

The Getting Started Guide for Moz Pro

SEO Training

If you have any questions about the tools or services, feel free to give us a shout at help@moz.com!

Sorry for the trouble! There are a few specific details that need to be present on those listings in order for us to appropriately detect and match them to your Moz Local data. Here is list of the criteria for those sources that will enable us to validate your listing:

• The name, address, and phone number (NAP) listed on the page must be an exact match with the listing in Moz Local.
• The primary phone number listed must be a unique local number or a toll-free number.
• The primary page category must be “local business”.
• A minimum of 2 visitor check-ins are required. Not sure what to do here? Head to Facebook's resources to see how to let people check in and how you can check in.
• The page must be fully accessible to all potential visitors, so any restrictions based on age, location, etc. must be disabled. This can be easily checked by attempting to view the Facebook page in a Chrome incognito browser while not logged into a Facebook account; if you can view the page normally in these conditions, the accessibility should be in good shape!

If you're still unable to determine why we're not picking it up, feel free to write in to help@moz.com and we'll be happy to investigate.

Hey there! Sorry for the trouble.

To take a look at this for you, we'd need to know what account and campaign this is under. I'd recommend shooting an email over to help@moz.com with those details and we can check out any crawl errors you might be receiving.

Thanks!

Hey Justin!

It usually takes only a few hours to populate your keyword metrics in your list, but sometimes it can take up to 24 hours. If you're not seeing data populate after that time feel free to write into us at help@moz.com, and we can take a look!

Hey there! Yes, we do support Moz Local in Canada now.

-- update: the new Moz Pro site crawler is now live, this means we can now crawl your SNI site. If you have any queries please check this post on fixing 803 errors, or reach out to help@moz.com --

Hey there!

Patrick linked to a really helpful Q&A article, but the other big cause for an 803 error would be SNI (Server Name Indication). Unfortunately I don't see the actual domain included in your question, so it's hard to be sure, but that's usually the prime suspect. Our current site crawler does not support SNI and if that is in use on your site, we will have trouble crawling it.

The good news is that we have begun to develop a new crawler that supports SNI, which is currently in beta. If you're interested in being a part of the beta testing, you can head here to sign up: http://goo.gl/forms/LCvL9Ix8JDHfbAvr1

I hope that helps! Feel free to reach out to us at help@moz.com if you want to discuss these errors in greater detail on a non-public forum.

Hey there! Sorry for any inconvenience here.

Unfortunately Rank Tracker was never super great at those daily rankings. There was some cached data involved, and it was never meant to be a full solution for daily ranking updates. We will be sure to let our product team know you'd like to see a daily ranking solution within the Moz tools.

Feel free to let us know if you have any other questions!

Hey Glenn!

Most of that should be achievable with the campaign crawl. The only limitation might be item A, as we currently do not have a function to exclude specific subdomains. You might be able to block rogerbot in those subdomains' robots.txt file to prevent us from crawling those areas of the site.

Weekly tracking is the default timeframe for campaigns, so that should be no issue! If you want to control when the crawl happens, you can create your campaigns on the day before you wish to receive data (it takes ~24 hrs to process new crawl information and populate it in the campaign).

If you have any other questions about settings things up, feel free to reach to us at help@moz.com!

Hi there! Sorry for any confusion about that notice.

When you see a negative Difficulty or Priority score in a CSV, or a status of "unavailable" in your list, that means the system encountered an error when trying to pull that data. If you're still seeing it happen, please email us at help@moz.com with the name of the List and account details, and we can look into it! Thanks!

Hi there,

Thanks for the question!

The answer is that Moz actually uses more robust depersonalization methods when querying for Google rankings. Our process completely strips personalization to provide a result that is more representative of a national average for all searchers in the country. You may not be able to reproduce these exact SERPs within your browser even if you used incognito, because your location is factored into your search results. So, there can be a lot of variation in what different people, searching from different computers/locations, might see in the rankings.

Our solution has been to run searches from a variety of IP addresses and IP blocks using non-personalized, search history/location-agnostic requests. In our experience, these have provided the most accurate results.

I hope that clears up how that works!

Hi Trevor!

As of right now, the next index is still scheduled for release on Friday. If a change to this date occurs, you will see it reflected on the Mozscape API Updates page. If something were to happen to push back this estimated date, we would announce it on that page as soon as the delay occurred.

I hope that helps!

Hi Charley!

We ran a few tests on the page in question and it appears that there is some Javascript on this page that is causing trouble for rogerbot, out crawler. The '#.’ portion of the URL is injecting a script. If you remove the everything after the ‘#.' in your URL, you should be able to crawl the page successfully!

It’s hard to confirm this without verifying which keyword you’re optimizing the page for, but if you continue to run into problems or have additional questions please write in to us at help@moz.com!

Hi there! Sorry for any confusion.

In a case like this it's hard to determine what's going on without investigating the campaign itself, so if you are still unsure why this data is populating I'd recommend reaching out to the Help team at help@moz.com to take a closer look. We'll be happy to help diagnose what's going on.

Hi Brandon! Sorry about any confusion around this.

The reason you're seeing different scoring metrics is that we recently updated the Page Optimization section within your campaign. We realized the A-F grading system, while understandable in certain countries, is not used world-wide. It was causing confusion so we changed it to a 1-100 scoring system. We also adjusted some of the weighting of the optimization factors and added new explanations for the on-page issues. The Page Grader tool has not yet seen some of these updates, so you'll still see the old scoring system there, and because of the differences in weighting for the factors you might see slightly different scores. We plan to get the Page Grader up to par in the future!

I hope that clarifies things!

Hey there!

Your traffic data in your campaign is imported directly from your Google Analytics account. We don't change or alter it, so if you're seeing dropped traffic there can be a few different causes.

If your traffic in your Moz campaign is lower than what you're seeing in GA, this is likely due to a connectivity issue the prevented us from collecting your traffic data on a daily basis. Oftentimes this is caused by expired or invalid tokens. We recommend reconnecting that token to restore traffic data. You can double check this by heading into your Traffic from Search section and switching the timeframe to daily. You may see missing data points from the days it wasn't connected.

If your Moz traffic matches what you're seeing in GA (as it sounds like is the case for you), this might be an issue on GA's end. We would recommend troubleshooting with Google to find potential causes.

Traffic drops can also be due to SEO-related issues. Unfortunately, we can't diagnose SEO root causes for you, but you can definitely use Moz Pro to research why it might have happened. Did you have an increase in crawl errors that might be preventing people from reaching your site? Did a competitor make big strides recently? The Q&A forum is a great place to reach out to SEO experts who might be able to help. You might also consider reaching out to an SEO consultant to look into the issue!

Hey there!

Without knowing the example keywords you're looking at, it's hard to check on these, but I can certainly speak to how Moz calculates the Difficulty score! We look at the Difficulty scores of the top 10 rankings sites in the Google SERP. If you're looking at Keyword Explorer, you can head to the SERP analysis section of a keyword report to see exactly which sites those are. If you're seeing something odd with the scores, feel free to reach out to us at help@moz.com with a few keyword examples and we can take a closer look!

For more details on how we calculate our metrics, check out this article in our Help Hub.

Hi there Michael! Sorry to hear your link count has gone down.

With each new index release, it's possible that older or less relevant links to your site have fallen out of the index. Generally, we suggest using a wide variety of backlink tools to get the most illustrative picture of how your site's backlink profile looks. OSE and Ahrefs index links differently and have different purposes. Ahrefs is good for quantity while OSE is great for finding higher quality links. Google Webmasters Tool is another great resource.

In a situation like this we recommend working on building links from sites with high Mozrank. You can learn more about link building in our handy guide!

I hope that helps!

Hey there Joseph! Sorry to hear you're having trouble running a crawl.

In a case like this, we would recommend reaching out to the Help Team at help@moz.com with details of your issue so that we can diagnose the problem! We'll be happy to look into the issue for you.

Thanks! We hope to hear from you soon!

Thank you for the feedback!

We're always looking for ways to improve the user experience with our products. We can see why the general use of the word 'You' might be less useful in a scenario in which your competitors are your own company brands, as well as why inconsistency with graph colors might be confusing. We'll send the product teams this feedback!

Sorry for any trouble! While there can be a small time period after an index update in which the API is updated but the tools and apps built from it have not yet switched over to the new data, at this point everything from the July 27 update should be available from all sources. If you're seeing incorrect or inconsistent data, feel free to reach out to us at help@moz.com with the domains and URLs that you're seeing issues with, and we can look into it. Thanks!

Hi there!

The Moz index is large, but it does not cover the entire web. We work on a breadth-first approach, so it's much more likely we'll have data from the top level pages of your site (like the homepage) before we find link data for individual pages lower in the site structure. If we are not reporting link data for a page, it does not mean there are absolutely no links out the on the web, it means we just haven't found them yet!

We generally recommend using a wide variety of tools to get a full picture of your backlink profile. We tend to focus on collecting higher quality links rather than quantities of links. The best way to get your page to show up in our index is to work on building high-quality links from sites with high Domain Authority and MozRank/MozTrust!

I hope that helps clarify things!

Hi Peter!

Keyword Difficulty takes into account the Page Authority (PA) and Domain Authority (DA) scores of the results ranking on the first page of Google for the given query, as well as modifying intelligently for projected click-through-rate of a given page (putting more weight on higher-ranking, more visible pages and less on lower-ranking, less visible pages). The formula also accounts for newer pages on powerful domains that may have DA scores but have not yet been assigned PA values.

I hope that provides some clarification!

Hey there! Thanks for the question!

Unfortunately we don't support automated CSV report emails at this time. You can manually request these emails in theRankings section of your campaign. I'll be sure to let the product team know this is something you're interested in seeing, however!

We can certainly check on it if you provide the domain! I would recommend sending in the information to help@moz.com where you particular case can be discussed outside the public forum.

Hi there! Moz's crawler, rogerbot, does follow robots.txt. When he's not following robots.txt, it's usually because the robots.txt protocol is formatted improperly. Learn more about formatting your page here: https://moz.com/learn/seo/robotstxt

For more information on Roger, including how to block him, head here: https://moz.com/help/guides/moz-procedures/what-is-rogerbot

And if you want to test your formatting, try the Robots Checker here: https://support.google.com/webmasters/answer/6062598

If you're still unable to determine why rogerbot is crawling your site, feel free to write in to help@moz.com!

Hey there Patrick! Glad to hear you're enjoying Keyword Explorer so far!

While I can't speak to upcoming unannounced feature releases, I know this is a popular request and I'll be sure to pass your feedback along to our product team! In regards to the best current workaround to get at that local keyword data, you've hit the nail on the head with geo-modifying your searches.

Feel free to let us know if you have any other feedback!

Hey there! Yep, you're right - that's still where we post updates about our index releases.

Hi Gareth,

When the index is updated, it's possible you may see your number backlinks drop. When we collect this data, we’re looking specifically for the most valuable links rather than crawling your entire site or every site. Our index stores link data for up to 6 months, and if links are not re-discovered from external linking sites they may fall out of the index. It is also possible that we found your links again, but that they did not meet our relevancy threshold and were excluded from the index.

Unfortunately there isn't an easy way to see which specific links were lost between index updates. The best thing we can recommend is to download a CSV of your links to use as a point of comparison for future updates.

I hope that clarifies things!

Hi there! We do take canonicals into account. Our tool has a 90% tolerance for duplicate content, which means it will flag any content that has 90% of the same code between pages. This includes all the source code on the page and not just the viewable text. If you're seeing duplicate content flagged, it's likely due to issues with how the canonical tags are set up.

For more info on canonicalization best practices, check out this article: https://moz.com/learn/seo/canonicalization

If you're still unsure why your pages are being flagged, feel free to reach out to us at help@moz.com!

Hey there!

The only external tool that we currently integrate with is Google Analytics (and Google My Business, in Moz Local). It's certainly possible that third party sites may use our API, but that would be through interface work done on their end to use our link data! Unfortunately we do not integrate with DashThis directly within our tools. However, we can pass along this feedback to our product team! Is there a certain functionality in DashThis that you especially like?