Welcome to the Q&A Forum

Hi Everyone,

Thanks for writing in. We don't have a set "number" for when invites will go out to specific users from the invite list, since we will be letting users into the beta in groups and not one at a time. For example, PRO members that are attending MozCon will be given beta access for their current campaigns starting tomorrow, so that is about 900 users that are all being let in at the same time, users that technically all have the same place in line. Even if we had your exact place in the invite list, the timeline for when you would have access can vary since we are letting testers in incrementally as we determine that the product is stable for current users of the beta. I know it can be frustrating that we don't have an exact timeline for each user, but we are hoping to have everyone in Moz Analytics within the next three months. I'm sorry we can't be more specific for individual users! :[

Please let me know if you have any other questiions.

Chiaryn
Help Team Ninja

I'm really sorry that you're running into this issue! We recently discovered that Squarespace's automated server systems have blocked our bot from accessing sites they host with a 403 Forbidden status. We are working with them to find a resolution to this block, but I am afraid that I am not certain if or when this will be resolved.

I apologize for the inconvenience this causes! Thank you for bearing with us while we work to get this resolved.

Hey Scott,

Again, we're sorry about the odd jump in duplicate content errors!

We just launched a new crawler and it is being extremely sensitive to duplicate content. As of now we are picking up duplicate pages on your domain via:

https clones of URLs

Some pages have a “/” trailing after the URL and some don’t

We are also ignoring some rel=canonical directives

This is an issue that other users are seeing with their crawls. Our engineers have made some changes to the crawler to scale back the sensitivity to these issues on the crawler and you should be seeing the changes within a week or two.

We're really sorry for the confusion.

Best of Luck,

Chiaryn

It is important to keep in mind that the Search Visibility metric relates only to the keywords you are tracking, so it isn't exactly correct to say that the Search Visibility score is skewed if you are tracking branded keywords. This is an accurate visibility score for the keywords you are tracking.

You can definitely see the Search Visibility for all of your non-branded keywords by using the filters as you suggested, which will give you a different perspective of your Search Visibility versus your competitors.

However, you could say that, in and of itself, the score is somewhat skewed just by the fact that these are the keywords you have chosen to target, rather than the total Search Visibility for all of the keywords you and your competitors may be ranking for. If your competitors aren't specifically targeting the same keywords you are tracking, you may be ranking better for those keywords, but you may not necessarily be as competitive in the overall rankings for every keyword. Our metrics can only be calculated for the terms you choose to track, so it is really just a view of the keywords you are targeting and not necessarily the full picture of your visibility as a site overall.

Hi Craig,

We aren't SEOs or web devs on the help team, so it is hard for me to say how the errors you are seeing effect your rankings or exactly how to fix them, but I can direct you to an insightful post from one of our long time members of our community here: https://moz.com/community/q/how-do-fix-an-803-error

From Sha's answer there, it looks like this shouldn't disrupt Googlebot's ability to index your site and I do see 303 results when I run a site:www.mangofurniture.co.uk search in Google, so it does look like they are indexing your site and I'm not really certain why your homepage wouldn't be ranking. There are a lot of SEO related reasons that could happen.

Since I can't provide more insight into the SEO side of this question, I'm switching the category over to Technical SEO Issues for you, so you can hopefully get a better answer from one of the experts here.

Hi Christopher,

Thanks for writing in with a great question. Unfortunately, there is no way to manually submit links to our index manually. All of the information we collect comes from an actual crawl of data in the internet, starting with the top 10 billion URLs with the highest MozRank. We then crawl from the top down until we've crawled about 70 billion pages and then collate the data that was collected by following all of those links. The information is all automatically collected at this time.

You may consider adding this as a feature request so our product department might look into adding the ability to submit links in the future. Here's the feature request forum we use to collect ideas: http://seomoz.zendesk.com/forums/293194-seomoz-pro-feature-requests

You can add your request to submit links to the index and vote for other features you'd like to see and suggest your own, both of which help our product team in deciding what to build next.

Let me know if you have any other questions.

-Chiaryn

Hi there!

I took a look at your campaign and it seems that we crawled a lot more page of the site this week in general than we did the previous week. Two weeks ago, we crawled about 500 pages and this week the crawl jumped up to 2800. So it isn't that there are more duplicate pages on your site now, it is just that we are able to crawl more pages now than we were before, which led to us finding even more duplicate pages that had not been reported before.

As for why we are crawling so many more pages, it could be for a few reasons. If you made changes to the links on your site, the page hierarchy of the site, or if you remove noindex tags or updated the robots.txt file for the site, those things could all affect how we are able to crawl the site.

I hope this helps! Please let me know if I can help you with anything else.

Chiaryn
Help Team Sensei

Hi Bernardo,

You can certainly share your login credentials with the contractor. We don't put any restrictions on how many people can be logged into the account at one time and that is the only way to share access to the data, so you are more than welcome to share your credentials, but the contractor will have full access to the account.

As ColinSV mentions, you can also create a custom report that cc's the contractor directly when the report is generated, so they can review the campaign data without having full access to the account.

I hope this helps. Let me know if you have any other questions.

-Chiaryn

Hi Ayman,

Thank you for taking Francisco's advice and contacting us at help@seomoz.org. I have answered your question there, but I also wanted to post here that we are currently working on adding more search engine options in our web app and Google Kuwait is among them. Unfortunately, we don't have an estimated date for when this search engine will become available, so thank you for your patience while we work on updating our system.

Please let us know if you need help with anything else.

Chiaryn

Hey Kevin,

This is actually a great question.

Google isn't very open about how they select sites for the rankings, so we have to base this type of report on best practices and past experience so some keywords can have funky results.

For the location specific keyword, you can almost use the Private Dining report as a mirror for the Private Dining Sacramento report. While Google knows your business is in Sacramento, our tool is only looking for specific words in the code and content of the page and does not take location into account. To the On-Page tool Sacramento is just a collection of letters, but Google would infer that you are targeting users in Sacramento when looking at how well the page is optimized for Private Dining.

As for the reason why the site would not be ranking for the more broad keyword but would be for the location specific keyword, that is most likely because you are optimized for the term Private Dining and the location specific version of the keyword is not as competitive as the more nationally applicable keyword would be.

I hope that makes sense! Let me know if you need any clarification.

-Chiaryn

Hey There,

I took a look at your site and it would seem that all of the links on the page bubblingwithenergy.info actually lead to pages on the www.bubblingwithenergy.info subdomain. Unfortunately, our crawl test tool only tracks sites at the subdomain level, so you would need run the crawl test for www.bubblingwithenergy.info to get a full crawl of the site.

I hope this helps! Please let me know if you need any further assistance with your crawl test.

Chiaryn

Hi Ilhaam,

Thanks for writing in and sorry that you didn't receive a full crawl. Unfortunately, we had an issue with our crawler starting yesterday evening that caused some crawls not to complete properly. Our engineers have already completed a fix for this problem and we have gotten you a full crawl now. You should be able to access the updated data on your account now.

If you're still running into any issues, please email us at help@seomoz so we can look into the issue for you.

-Chiaryn

Hey Jay,

I checked two of the pages:

http://www.downpour.com/catalogsearch/advanced/byNarrator/narrator/Seth+Green/?bioid=5554 and http://www.downpour.com/catalogsearch/advanced/byAuthor/author/Solomon+Northup/?bioid=11758 against each other in a duplicate content checker (http://www.webconfs.com/similar-page-checker.php) and they returned a similarity percentage of 67%, which we definitely shouldn't be showing as duplicate. (We consider pages at 90% or more to be dupes.)

I went to check on your crawl to see if it might be a bug and it looks like the number of duplicate content errors has gone down a lot with the crawl that took place today and none of these pages are included as duplicates, so it may have been a temporary bug. If you see these pages counted as duplicates again. Please let us know so that we can look into it further.

Hopefully, this helps!

Chiaryn

Hi there,

You’re probably aware of Google’s upcoming algorithm update, which includes Core Web Vitals as a ranking factor and will now be released throughout summer 2021.

With this announcement, it’s important that modern SEOs prioritize steps to ensure their site’s are user-(and search engine-)friendly. To help you get ahead of this, I’m super excited to announce our Performance Metrics beta – available for Pro customers on all plans, up to 6,000 pages per Campaign per month.
 You can check it out here.

In the beta, you can streamline your technical audit workflows and analyze thousands of URLs of your choosing for Core Web Vitals and other performance metrics.

You can also:

• Analyze performance on an ad-hoc basis, separate from full site audits
• Report on performance across mobile and desktop, at scale
• Understand performance in the context of other search data, like Page Authority, other crawl issues, and top pages from traffic
• See a breakdown of how many pages require fixes, need some improvement, or look good
• Filter and manipulate your performance data with CSV exports
• Analyze individual page reports for Core Web Vitals and additional performance metrics.
• Deep-dive into the opportunities on how to fix issues
• Receive powerful prioritization recommendations

We have a list of features and functionality on our roadmap, but we'd love to hear your thoughts! Go check it out, analyze your important pages for performance, and comment below!

Got questions? I’m also here to help.

Also make sure to check out other helpful resources, like our Help Hub documentation, Learn Center content, announcement blog post, or our webinar “Make Core Web Vitals Your Competitive Advantage” with Moz’s Senior Search Scientist Tom Capper (recorded live on April 27.).

Hi Everyone,

Thanks for posting and responding to this question, respectively. I am going to repost the answer to this change from our in-house SEO:

We've given the "keys" to our directories list/database to +Ian Lurie , who is collaborating with +Mackenzie Fogelson and Distilled to put together a more robust and scalable solution for directories. With everything else we've got going on, we decided that curating the directories list was beyond the time/resources we have to devote to it. I know this gang of trusted providers will do a great job with it! Other than redirecting the page and handing over the existing list, +Moz won't be actively involved with the project.

I hope this clears things up. Please let me know if you have any other question.

Chiaryn

Hi Hugh,

Regarding the duplicate titles, we only report that if the titles are 100% similar. It may not be considered a huge problem in terms of SEO, but we do still think it is important to report on it as it can have some effect on the pages competing against each other.

As for the duplicate content, campaigns have a 90% tolerance for duplicate content, which means they will flag any content that has 90% of the same code between pages. This includes all the source code on the page and not just the viewable text. Although the pages in question may appear to be different on the front end, they are actually duplicates based on this percentage (at least the example URLs I checked in your campaigns.)

You can run your own tests using this tool: http://www.webconfs.com/similar-page-checker.php

We don't know what standard Google uses, but it's safe to say they are a bit more sophisticated than us - so you might be okay in this regard as long as you have a couple hundred words of unique text per page. Google won't say how much duplicate content is too much, so we think it's better to be safe than sorry.

Hi There,

Sorry that your graphs aren't loading properly. It isn't normal for the graph to take such a long time to load and there doesn't seem to be any issue with your Analytics connection. I checked all three of your campaigns and I am seeing that the organic traffic graphs are taking longer than normal to load. I'm seeing all of them eventually load, but it does seem that some of them are taking about a full minute so I will need to send this to our engineers to look into. I'm going to create a ticket in our help desk and use that to communicate with you and the engineers about this issue. You will receive an email from our help desk once the ticket has been created with a link to access the ticket and you can reply to me there with any further information or questions you may have.

-Chiaryn

Hey Dan,

Thanks for writing in with a great question. Right now, we do not have a way to give an additional user a separate login to the account, though we are working on that for the future, but we don't have an eta for when this feature will be released. Currently, the only option to give another user access to the account is to share your login credentials with them, I'm afraid. In the meantime, if you would just like to share data with the employee, you can set up a custom reprot to be emailed directly to them from your campaign.

I apologize for the inconvenience while we work to add secondary logins to the account.

Chiaryn

Hey Pascal,

Sorry for the confusion here! It looks like the subdomain, www.car-moderne.ch, returns a 200 HTTP status to our crawler and to other crawlers, such as the hurl.it tool. In the body of the screenshot I attached from the hurl.it tool, the only code there is the number 404, so basically the site is serving a page with no crawlable data. The page isn't redirecting and it doesn't return any real source code, so there is no data for us to include in the crawl. I would recommend working with your webmaster to resolve this issue and to get the page to correctly serve a 301 redirect to the /fr version of the site to all crawlers.

I can see that the site is correctly responding with a 301 redirect for some crawlers, such as this test I ran as googlebot, but the response doesn't seem to be consistent. One thing you will want to be sure to have your webmaster check is how the site responds to user-agents that are hosted on Amazon Web Services, as some of our crawlers and the hurl.it crawl are both hosted through AWS.

Once the issue of the HTTP response is resolved, you should be able to get much better data from the crawl test tool.

I hope this helps! Please let me know if I can help you with anything else.

Chiaryn

Hey Steve,

Thanks for writing in and sorry the data is looking off in OSE. Our index is currently showing data that was collected prior to March 19th, so it may be that dianomioffers.co.uk made changes to the links since we collected data for the index. Unfortunately, this issue is a bit difficult to troubleshoot because I can only see how the links are currently formatted on the site and I the only reference I have to how the links were formatted previously would be what we are showing in the index. We did previously have an index out that was released on March 29th, but due to some data retention issues, we had to role back to the older index. We are expecting to update back to the more current release by Thursday, so you may want to check again and see if the information for these links has been updated in the more current version of the index.

I hope this helps. Please let me know if you have any other questions.

-Chiaryn

Update from the Moz Support Team: Please read our update timeframes guide for avoiding delay.

Hey Arthur,

Thanks for reaching out and your interest in Moz Local!

In terms of our direct partners, when you publish a listing using Moz Local, the time it takes our partners to update the listing really depends on how long it takes them to accept the data we push to them and update the information across their servers. This can be anywhere from 1 to 8 weeks but generally is completed by around 4 weeks.

As for our Check Listing tool, that data is pulled live each time a check is run, so we display exactly what the different directories (including our partners) are providing through their backend APIs. It can take those directories up to 8 weeks  (with an average of about 4 weeks) anytime you update the data through the directories and engines directly.

I hope this helps! Please let me know if I can help you with anything else.

Chiaryn
Help Team Ninja

Hey there! You can actually ignore an entire issue type from the top of the page. Just navigate to the issue type and click the "Ignore issue type" button in the top right corner of the page. This will ignore all pages with this issue type going forward.

Here is a screenshot to help:

https://www.screencast.com/t/PQUSt59or9lQ

Hey Lawrence,

I checked a few of the pages that are listed as having a meta refresh on the Australia version of the site and it looks like the meta refreshes have been removed in the source code, but the last crawl was on the 14th for that site, so you would just need to wait for the next crawl to come through sometime today to see those changes reflected in the crawl. The same goes for the US and New Zealand version of the site. All three crawls will be updated within the next couple of days, so you should see those meta refresh errors drop off for those campaigns after the new crawls complete, as they did for your other three campaigns in their recent crawls.

Please let me know if I can help you with anything else.

-Chiaryn

Hey Mogens,

I would actually recommend that you take a look at the On-Page report for this pairing that we are generating in your actual campaign vs. the research tool, as we have recently updated the campaign On-Page grader to be more accurate and explicit about the issues we find. We still intend to update the research tool version, but it still shows outdated report information. You can find this report on the Discover tab under Search>On-Page Optimization within your campaign.

Take a look at that and let me know if you still need help understanding the issues we have found for this pairing there.

I hope this helps!

Hey Julien,

While it can take a few days for a crawl to finish up, it does look like your site has been crawling for about 4 days, which is a little longer than usual. I'm really sorry about that! I'm going to create a ticket in our help desk under your email for the engineers to look into. You should get a confirmation email once I've submitted the ticket with a link to the ticket for your reference.

-Chiaryn

Hey Gerard,

Paddy's right that it can be about 4-8 weeks to see the Just Discovered links show up in the main index, but we also had a delay in this most recent update so the data is not as fresh as it normally would be. Normally, the data in the index is collected for about three weeks prior to the update, while the data for this index is probably closer to 6 weeks. Even so, we began feeding sites and links into the scheduler to be included in the next index well before we start collecting data. This means that, even if we found your links in Just Discovered links 6 or 7 weeks ago, those links might not have made it into the scheduler for this most recent update. They should be in the schedule for our next update, however.

I would say that it can be several updates before you see the links from Just Discovered show up as fully established links in the index as a general rule. We are working on a project that will make the index update with much fresher data in the future.

I hope this information helps. Please let me know if you have any other questions.

Chiaryn

In all likelihood, this is not related to the Squarespace issue, but actually to the .agency tld. Since pretty much anything can be used as a tld now, but our crawlers were built before this was allowable, we aren't set up to automatically recognize custom tlds. The standalone on-page grader is our oldest and most rudimentary crawler tool, so it is also updated the least frequently.

You can create a campaign for lightningjar.agency with no issue and there you would get on-page grades from our newly updated campaign on-page grader that is much more accurate.

Hi there!

I agree that Adam's answer is a good answer to your question and just wanted to add that we do not include personalized results for any of our rankings, even based on the location of our servers. There can be a lot of variation in what different people, searching from different computers/locations might see in the rankings. Our solution has been to run searches from a variety of IP addresses and IP blocks using non-personalized, search history/location agnostic requests. In our experience, these have provided the most accurate results, showing what the "most" users see, though we know there's still quite a bit of room for fluctuation.

Most search engines will personalize your results based on your search history. It does help to recommend that your clients are logged out when performing a search. For Google, they can also try adding &pws=0 to the end of the query string to help remove personalized results.

Search engines also customize results based on location. This means users in one city often see very different results than users in another location.

I hope this helps! If you have any other questions about this, or any of our tools, I recommend that you write in to us at help@seomoz.org. That's what the Help Team is here for !

-Chiaryn

Hey There,

It looks like Donna answered your question about OSE, but I wanted to follow up about the 404 you are seeing in the crawl test for http://www.hoesjescases.nl. Unfortunately, the 404 response is what is being returned from your server to our crawler: http://www.screencast.com/t/HaQJ2zd0wiG4. I did check other HTTP checkers, like hurl.it, and I'm getting a 200 for your site, so the response does seem specific to our crawler. It may be that the webmaster intended to have the server return a 403 forbidden error or something like that (which we still wouldn't be able to crawl, but would be the correct error if we are purposefully blocked), but you would need to talk to your web host to resolve the issue.

I hope this helps! Please let me know if I can help you with anything else.

Chiaryn

Hey Rhonda,

I took a look at your crawl test and I don't see that we are reporting any duplicate pages for http://www.radiantguard.com or http://www.radiantguard.com/. We are actually reporting that http://www.radiantguard.com/ is the canonical tag of http://www.radiantguard.com and we would never report a page as a duplicate of the canonical tag. We do consider these two pages as separate pages, as many sites do also treat them differently, so we try to encompass the most sites with the way we report on pages with trailing slashes.

You may still want to consider Ryan's advice regarding how to deal with these two pages, however, I just wanted to clarify that we are not reporting any duplicates on either pages. Here is a screenshot of the CSV that shows that these pages have no reported duplicates: http://www.screencast.com/t/5FHTfyQe

I hope that helps to clear things up a bit, but please do let me know if you have more questions about the crawl report.

Hi There,

Thanks for writing in and sorry that you are running into some issues with the Keyword Difficulty tool. Unfortunately, Google has changed the way that they present rankings information, so we have had to make some changes to our collection in order to keep up with these changes, I'm afraid that this has caused some issues with providing the real time data for the Keyword Difficulty tool and the tool is currently unresponsive. We are hopeful to have the tool working again within the week, but at this time, unfortunately, we do not have an exact ETA for when that tool will be up and running again. I thank you for your patience while we work to resolve this issue.

We will be posting updates on this issue in our Known Issues forum when they become available. You can access that forum here: https://seomoz.zendesk.com/entries/22457872-keyword-difficulty-and-rank-tracker-issues

I apologize for any inconvenience this may cause.

-Chiaryn

Eric and Andrew are both right on this one; PA can definitely be higher than DA in certain situations.

PA is a measure of how likely a page is to rank against any other page in our index, while DA is the same thing for a domain rather than just one page. You can definitely have one page on a domain that ranks well while all of the other pages aren't doing so great.

Both DA and PA are calculated based on a large number of metrics so, while they aren't mutually exclusive, they aren't directly correlated either. DA is taken into account when calculating PA, so a low DA could bring down a high PA a bit, but it doesn't negate all of the other metrics that would make the PA high.

I hope this helps to clear things up!

Hey there! I just followed up on the message you sent into our help team, but I wanted to also post the answer here for reference.

It looks like the robots.txt file may have recently been changed for the site because I created a new campaign for the subdomain and I am not getting that same error. You should no longer see this error on your next campaign update or you could create a new campaign and you would no longer see the error there.

I did notice that you ran a number of crawl tests on the site since the campaign update, but the important thing to realize is that the crawl test can be cached for up to 48 hours. (I removed the crawls in this version of the screenshot for privacy.) We also cache the crawl tests from campaign crawls, so it looks like the first crawl test you ran on the 29th was cached from your campaign crawl and the two subsequent crawl tests were cached from that first crawl test.

Again, I wanted to note that it looks like there are only links to about 2 other pages (terms and privacy) that are on the specific subdomain you are tracking, so we aren't able to crawl beyond those pages. When you limit a campaign to a specific subdomain, we can only access and crawl links that are within the same subdomain.

Hi Laurance,

Thanks for writing in and sorry that your crawl never completed. I'm afraid the issue is that all crawlers are being blocked in the robots.txt file of the site and we aren't able to fully access the site to complete a crawl. If you were to update the robots.txt file to allow our crawler to access the site, we would than be able to get the crawl completed for you. You can use the user-agent rogerbot to specify our crawler or you can remove the disallow: / directive from the robots.txt file to allow us access. Once you've done that, let me know and I will have our engineers complete the crawl for you.

I look forward to hearing back soon.

-Chiaryn

Hey Radi,

The link metrics section of your campaign pulls from our Mozscape index, which updates about once a month.

Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for a variety of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.

Just so you know, here's how we compile our index:

• We grab the most recent index
• We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains)
• We start crawling from the top down until we've crawled 180,000,000,000 pages (which is about 35% the amount in Google's index)

Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update), then it won't show up in our index.

We update our Mozscape Index every 4-8 weeks. Crawling the entire Internet to look for links takes ~2-4 weeks, but our crawlers are always collecting data. When we need to put the index together, we grab all the data they have collected and start processing, which can take up to 3 weeks to determine which of those links are the most important.

Mozscape focuses on a breadth-first approach. This means that we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. But deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates until we catch all of these.

If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked to by other documents on the web, or our index will not include them.

I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see them in OSE next month!

Hey Nina, sorry your crawl data is looking a bit off.

We don't count 301 redirects in the duplicate content, so it may be that these pages were not yet redirected when we crawled or that they are responding differently to our crawler than they would in a browser. However, it is difficult for me to say without looking into the pages directly. Can you please let me know which campaign you are seeing this on so that I can investigate further?

If you prefer not to mention the campaign name in this public forum, you can email help@moz.com directly or use the contact form here: https://moz.com/help/contact/pro. You can just mention that you are replying to Chiaryn in your message and it will make its way directly to me.

I look forward to hearing back from you soon.

Hey Teemu,

Thanks for writing in and sorry that you are having some issues with the Historical PageRank tool. Unfortunately, this is an older tool that we don't no longer support so it can sometimes be buggy. We do keep this tool available because sometimes the tool can still provide data with great value, but I'm afraid that it oftentimes does not work properly. I'm really sorry about that!

I just tested out the tool for a handful of URLs. For some it brought up data on the first try, but others required submitting the URL a few times, but I did eventually get data for all of the URLs so I would recommend retrying the tool a few times if you don't see an update immediately.

If you’d like to leave feedback about the tool, a great place for that would be in the SEOmoz Feature Request Forum. That is the forum our product team uses to prioritize tools and requests.

Thanks for your understanding! Please let me know if you have any other questions.

-Chiaryn

Hi Meghan,

I'm sorry to hear you're having some trouble with the Mozbar in Firefox. I logged into your account and was able to access the PRO features of the Mozbar in Firefox with no issues. If the solutions that Mike and Oleg suggested don't work for you, I would recommend clearing your cache and cookies and giving it another try. That usually fixes the issue.

If you are still running into the issue after that, please let me know and I will look into it further.

Hi there,

I'm really sorry that you haven't received all of the emails for your rankings updates. We recently switched our emails over to a new server, and it seems the issue you are experiencing is be related to that. Our engineers should be pushing out a fix in the next day or so to correct the bug and they will be monitoring our emailing system closely to make sure this doesn't happen again. I apologize for any inconvenience this caused.

In the meantime, you should be able to view and download your most recent rankings reports from the Rankings tab of your campaigns.

-Chiaryn

Hi Michael,

Thanks for writing in. I already emailed you in response to the ticket you sent in to the Help Desk, but I will copy my answer here for you review.

--

I looked into your campaign and it seems that this is happening because of where your canonical tags are pointing. These pages are considered duplicates because their canonical tags point to different URLs. For example, http://www.woolovers.com/british-wool/mens/tweed-green/wool-countryman-suede-patch-sweater.aspx is considered a duplicate of http://www.woolovers.com/british-wool/mens/olive-green/wool-countryman-suede-patch-sweater.aspx?p=true&rspage=4 because the canonical tag for the first page is http://www.woolovers.com/british-wool/mens/tweed-green/wool-countryman-suede-patch-sweater.aspx while the canonical for the second URL ishttp://www.woolovers.com/british-wool/mens/olive-green/wool-countryman-suede-patch-sweater.aspx, with one URL showing tweed-green and the other showing olive-green.

Since the canonical tags point to different URLs it is assumed that http://www.woolovers.com/british-wool/mens/tweed-green/wool-countryman-suede-patch-sweater.aspx and http://www.woolovers.com/british-wool/mens/olive-green/wool-countryman-suede-patch-sweater.aspx are likely to be duplicates themselves.

Here is how our system interprets duplicate content vs. rel canonical:

Assuming A, B, C, and D are all duplicates,

If A references B as the canonical, then they are not considered duplicates
If A and B both reference C as canonical, A and B are not considered duplicates of each other
If A references C as a canonical, A and B are considered duplicated
If A references C as canonical, B references D, then A and B are considered duplicates
The examples you've provided actually fall into the fourth example I've listed above.

I hope this clears things up. Please let me know if you have any other questions.

--

-Chiaryn

Hey There,

Thanks for writing in with a great question! Capitalization definitely shouldn't matter to our crawler or to Google, so I looked into this keyword with one of our devs and it looks like the rankings for "jobmesse" was collected about 16 hours before the rankings for "Jobmesse" so we believe this is actually a natural fluctuation in the SERP for this keyword. I manually check the current rankings for both version of the keyword, I am seeing that your site currently ranks at #11 and the keyword has a difficulty score of 56%, so it is definitely within reason to see fluctuate in a matter of hours between the rankings.

I hope this helps. Please let me know if you have any other questions.

Chiaryn

Hey There,

The robots.txt shouldn't really affect 403s; you would actually get a "blocked by robots.txt" error if that was the cause. Your server is basically telling us that we are not authorized to access your site. I agree with Mat that we are most likely being blocked in the htaccess file. It may be that your server is flagging our crawler and Xenu's crawler as troll crawlers or something along those lines. I ran a test on your URL using a non-existent crawler, Rogerbot with a capital R, and got a 200 status code back but when I run the test with our real crawler, rogerbot with a lowercase r, I get the 403 error (http://screencast.com/t/Sv9cozvY2f01). This tells me that the server is specifically blocking our crawler, but not all crawlers in general.

I hope this helps. Let me know if you have any other questions.

Chiaryn
Help Team Ninja

Hey Anne,

Thanks for writing in. We haven't had any other users reporting that their callto: or tel: links are showing up as relative links in their crawl diagnostics so I dug into the formatting a little bit. From the research I've done (http://demosthenes.info/blog/536/Adding-Phone-Numbers-To-Web-Pages-With-HTML5-and-Microdata), it seems that the links may be formatted incorrectly as they are missing the + symbol mentioned in the post before the number in the link. I also tried clicking the callto: link on the site from a mobile browser and the link was not handled correctly there either. Basically, nothing happened unless I held the link down and then my browser tried to open the page as a relative link, as well.

Since I am not a web dev, I can't really advise on the proper formatting for these links, so I think this would be a better question for the community as a whole. I am going to change the category of the question to Technical SEO Issues and Web Design, which will allow the community to advise the proper formatting for these types of links.

I hope this helps!

Chiaryn

Hi Michael,

Thanks for writing in and sorry for the confusion. Unfortunately, there is an issue with your brand rules that is causing the connection to Google Analytics to fail. You currently aren't tracking any keywords that match your brand rules, so the request to pull data for those rules fails and, after a number of failures, the connection to GA also fails. You can correct this issue by adding the brand rules as keywords and reconnecting your GA account. We will then pull in all of the historical data for the Analytics account and you should no longer see the error message on your campaign.

I hope this helps. Please let me know if you have any other questions.

Chiaryn

Hey Gentleman,

I'm sorry your running into this issue with your crawls. :[

We would definitely love to look into this for you guys, but it's a little difficult for us to do that through the Q&A forum. If you write in to help@seomoz.org with your campaign information, like SEO Consult suggested :], we can look into this issue and work on getting a fix for you.

We look forward to hearing from you both at the help desk.

Chiaryn Miranda

SEOmoz.org

Hey Kenny,

Thanks for writing in and for using our Open Site Explorer! I'm so sorry that you still haven't been able to see your links in Linkscape. Most new sites and links will be indexed by our spiders and available in Linkscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.

Just so you know, here's how we compile our index:     - We grab the most recent index.

- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).                                                                                                                     - We start crawling from the top down until we've crawled 59,000,000,000 pages (which is about 25% the amount in Google's index).

Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!

We update our Linkscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule

Linkscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.

If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Linkscape must be linked-to by other documents on the web or our index will not include them.

I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.

Best of luck,

Chiaryn

Hi There,

One important thing to note about Open Site Explorer is that the information for a site defaults to page specific metrics, while the campaign information will show you domain metrics. For example, if your competitor's site is www.example.com Open Site Explorer will show you only the links that point directly to that URL as a default while the campaign will show you the total number of link to all of the pages on the example.com root domain.

You can pull the root domain information by changing the of the filter on the Inbound Links tab (http://screencast.com/t/uxI55g8Noh) or going to the Compare Link Metrics tab (http://screencast.com/t/cXHEs0mpGK) in Open Site Explorer.

I hope this clears things up. Please let me know if you have any other questions.

Chiaryn

Hey Rafi,

I took a look at your campaigns but I didn't see one that is specifically returning an 803 error for the homepage, so I really need a bit more information in order to investigate what might be going on here. If you don't want to share the specific site publicly here, you can email us directly with the the campaign details or just click the blue circle on the bottom right corner of your account to message us directly from within the app with the details.

I look forward to hearing back from you soon.

Hey Scott,

Sorry that your metrics are looking off in Open Site Explorer. I took a look at your site in OSE and it looks like you are seeing only one internal link because we haven't yet indexed the pages and links within your site. You are seeing information for external links because we have indexed the external linking pages, but we have not indexed the pages within your site yet. You can see that here: http://www.opensiteexplorer.org/links.html?site=www.expresscasket.com%2Fsteel-caskets.aspx

I'm afraid it may take another index update or so before we are able to index your internal links. While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.

I hope this clears things up a bit. Please let us know if you have any other questions.

-Chiaryn