Unable to see internal link numbers on Opensiteexplorer - Need help
-
I'm Anuj, a regular user of SEOMOZ. I need some SEO guidance from SEO experts. I'm trying to optimize a webstore for few keywords. I am facing some issues on SEO
I was using https all over the webstore and was advised by the community members to not have https through out the site (Due to various reasons). The internal links were not showing up in opensiteexplorer & Google Webmaster Tools too when the site was with https (They were just showing 1 or 2). After changing the pages from https to http, I'm now able to see all the internal links of my website on GWT. Unfortunately, the internal link count on opensiteexplorer shows a very small fraction when compared to the # of internal links shown on GWT. The link update from Opensiteexplorer was on 27th FEB 2013.
I had done the https to http (for all pages) somewhere between 17-24th of JANUARY 2013.
I wanted to know if I have missed something as I am unable to see those numbers on Opensiteexplorer or will it take time for opensiteexplorer to show the internal link numbers ?
-
Hi Chiaryn Miranda,
Thanks for the detailed information. All my links are indexed by google & are link depth 1. However, having said this, I had made few changes in the month of Jan end. So , I guess I should be able to see the internal links in the coming update.
Regards,
Anuj
-
Hi Anuj,
Thanks for writing in and for using our Open Site Explorer! I'm so sorry that you still haven't been able to see your links in Mozscape. Most new sites and links will be indexed by our spiders and available in Mozscape and Open Site Explorer within 60 days, but some take even longer for many of reasons, including the crawl-ability of sites, the amount of inbound links to them, and the depth of pages in subdirectories.
Just so you know, here's how we compile our index:
- We grab the most recent index.
- We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains).
- We start crawling from the top down until we've crawled 59,000,000,000 pages (which is about 25% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Mozscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Mozscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Mozscape must be linked-to by other documents on the web or our index will not include them.
I hope this information helps! While the site and links may not be indexed yet, give it some time - maybe we'll see it in OSE next month.
Best of luck,
Chiaryn
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Creating Tables with Multiple Links
Hello, Is Creating Tables with Multiple Links and using schema markup bad SEO? For example I have a real estate website which I have a hierarchy of home page -> County pages -> city pages-> blog posts.. However at the bottom of the county pages I list the city pages i serve under a table with links..
On-Page Optimization | | sqc0 -
Should I add canonical links to pages that are redirected?
Hello! I am a little confused concerning canonical links. I have several URLs that all access my page, but I redirect them all. A lot of places I am told to redirect them or use canonicals. Other places, I read that I should always use canonicals. What is the right way for me? If I should use canonicals as well as redirects, which links should I do this on? I redirect my pages like this: http to https:
On-Page Optimization | | hermanok
http://example.com -> https://example.com www to non-www:
https://www.example.com -> https://example.com Remove trailing slashes
https://example.com/ -> https://example.com Would-be 404-requests to index.php?p=$1
https://example.com/home -> https://example.com/index.php?p=home ( show as https://example.com/home ) Example:
http://www.example.com/home/ -> http://www.example.com/home/ -> https://example.com/home/ -> https://example.com/home -> https://example.com/index.php?p=home ( shows as https://example.com/home ) Thank you!0 -
Cross-linking for mobile SEO
Hi everyone! I am having a hard time finding information about weather to/how to apply internal seo linking to mobile versions of sites. We decided to go with dynamic serving with user agent detection. Our desktop site has a quite heavy seo-internal-cross-linking. As I understand, for mobile we should simplify and focus on usability, so get rid of unnecessary links. But I have a doubt about weather removing this part of the web structure can hurt our SEO. Do Google mobile bots look at and rank mobile versions of pages from scratch or do they use what they know about the site and the site's structure from its desktop version?
On-Page Optimization | | ofertia0 -
Can someone help with Canonical?
I have a wordpress site that On-Page Grader is saying I don't have Canonical done correctly. Here is the comment. Appropriate Use of Rel Canonical If the canonical tag is pointing to a different URL, engines will not count this page as the reference resource and thus, it won't have an opportunity to rank. Make sure you're targeting the right page (if this isn't it, you can reset the target above) and then change the canonical tag to reference that URL. Recommendation: We check to make sure that IF you use canonical URL tags, it points to the right page. If the canonical tag points to a different URL, engines will not count this page as the reference resource and thus, it won't have an opportunity to rank. If you've not made this page the rel=canonical target, change the reference to this URL. NOTE: For pages not employing canonical URL tags, this factor does not apply. I have quite a few sites and have never had an issue with this. Can anyone help? I tried installing a plugin but that seems to have made it worse. This is the front page of the site btw.
On-Page Optimization | | jonnyholt1 -
How different does each page tilte need to be?
I've got a site that is all about wood countertops. There are a few ways people can find info on wood tops. (main) wood countertops (main) butcher block butcher block counters wood counters hardwood countertops etc. For the most part I want to rank for the two top key phrases because they pretty much cover all the other basis with google being as smart as it is. So they question is how different should each page title be? Examples: Wood Countertops - Butcher Block Counters | by J. Aaron = index page Wood Counter tops - Butcher Block Counters - About Us | J. Aaron = about us page Cleaning Butcher Block - Wood Countertop Maintenance | J. Aaron = care & maintenance page Would it be OK to use: <title>Wood Countertops - Butcher Block Counters | by J. Aaron</title> as the template for the whole site with the addition of the actual page subject as an additional piece of the sentence, like example 2 or would that be too similar? Also is that a good idea or should I commit to optimizing each page for a different key phrase? If so would you optimize the home page for the most searched for phrase and let the other pages back it up with the other search terms?
On-Page Optimization | | JAARON0 -
Need help with fluctuating ranking for a specific keyword
my website www.totalmanagement.com fluctuates for the search term: web based property management software I have been using SEO Moz for a few months now and have managed to get to the top 5 and jump around between 3 and 5. Does anyone have any suggestions to assist me? Long term goal is also to really target: Property Management Software But I am still very new at this. Thanks in advance for the help!
On-Page Optimization | | dgruhin0 -
Dropped rankings due to too many links, help needed
We have just re-designed our site and added a big drop-down navigation menu to help users get straight to the category/sub-category they are looking for, take a look at http://www.discountfiresupplies.co.uk to see what I mean. Since doing so our rankings have dropped which we've been told may be because there are now so many links on (particularly) the home page diluting the rankings of that page. We've been advised that if we hide the drop-down menus using "style='display: none'" until they are required that the search engines will ignore them which we have now done but is this correct or will they still be indexed? And if so do you have any other suggestions? Thanks, Tariq
On-Page Optimization | | tjhossy0 -
How unique do product descriptions need to be?
I'm rewriting approximately 10,000 product descriptions, but for feasability it's useful to sometimes reuse some of the phrases that are there (and on other websites as they come straight from the manufacturer -eg. key features), how unique does the content have to be - are we talking 100%, 75%, 50% for it to be effective in google? Same question goes for the product title! Many thanks.
On-Page Optimization | | ewanr0