Discrepancy between OSE internal links and Webmaster Tools
-
Hi,
We have been attempting to increase our rankings for our key term for a number of months now, and we are seeing an unusual discrepancy between OSE and Webmaster Tools that we believe may be causing us harm.
OSE shows our homepage, www.unionroom.com, as having only 27 internal links (only three of these aren't 301's too), whereas Webmaster Tools is showing just over 1,500 internal links to the homepage.
The three pages that OSE are displaying as linking back to the homepage are the homepage, our blog and our accessibility page. These pages are all ran off the same template and have the same header and footer (with three home links spread across header and footer). You can see our confusion!
Is this a case of OSE's stats being incorrect (the website has been live for ~6 months) or is there an issue with our in-linking structure that we are missing?
Thanks!
-
Yep that is correct, which can be 50/50.
-
Thanks for the link David, we will take a look through that.
I've quickly looked at some competitor websites and their home links are all href="/", so would I be correct in assuming that it if this affected our website it should also affect others in OSE?
-
To provide more detail there is a relative link back to the homepage though href="/" which our crawler doesn't work well with so having the full absolute path is recommended.
Here is a great resource that goes more in-depth about the differences: http://www.coffeecup.com/help/articles/absolute-vs-relative-pathslinks/
-
I ran some inner pages through OSE (/work and /contact) and both look to be indexed.
It's weird that you say 'For example we do have /blog/ indexed but there isn't a link going back to the homepage as "www.unionroom.com"' as this is one of only two pages (blog and accessibility) showing that DO link back to unionroom.com.
In summary:
- All inner pages are crawled.
- All inner pages (that we have tested) are indexed.
- All of our pages use the same template.
- OSE is stating that only two inner pages link back to the homepage (blog and accessibility).
-
It's possible we may not have indexed those pages or they have a link back to www.unionroom.com within the source code. You can verify by putting those pages into OSE directly to see if they have been indexed and also verify the link is in the source code.
For example we do have /blog/ indexed but there isn't a link going back to the homepage as "www.unionroom.com"
-
The crawl looks to be working correctly, as in it is finding all of the pages and posts that we would expect (approximately 300). It looks to be solely an issue with the number of internal links that OSE is saying the page www.unionroom.com has (27).
All but two of our inner pages, aside from the blog and accessibility, aren't listed on our internal link report for the homepage. This includes top level pages like services, about, contact etc, all missing.
The templates that we use for the blog and accessibility pages are identical to to what we use for other inner pages, so it's unusual that the others aren't listed.
-
Anytime!
Website structure can play a part but also time timing of when sites are indexed. There can be various networking issues that can prevent our crawler and others from reaching certain pages. You can always run a crawl test to look for any possible errors which you will have time to correct before the next update: https://moz.com/researchtools/crawl-test
Also some pages may be blocked intentionally from robots.txt and no-follow tags.
-
Hi David,
Thanks for your reply.
I'm concerned that on the competitor websites that we are evaluating using OSE, their websites' internal links are displaying much higher numbers than ours (27 vs ~300) even though our websites are of similar size. Could this possibly highlight an issue with our website structure (i.e. crawlers are having an issue finding ways back to the homepage via inner pages, even though we have three on each page around the website), or is this a case of MOZ crawling perhaps showing incorrect statistics?
I'm trying to eliminate the possibility of OSE's statistics being incorrect before we attempt to change the structure of the website and begin testing etc.
Thanks!
-
Hi Jordan!
There are a lot of reasons you could be seeing these data discrepancies. If you're seeing more GWT errors, it could be because they have 'discovered links' through different means. Moz starts with your home page and uses recursive crawling to find pages on your site. We keep crawling until we stop finding unique links, or until we hit your page crawl limit. Bottom line, when we crawl your site your homepage is the only seed. We know that Google uses multiple seeds, so it could be possible Google is indexing more pages that way. In sum Google will never match up with OSE but it's good to use both along with other backlink tools to cover all your bases.
Hope this helps!
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Using Link Tracking list to track 301 backlinks for my main site backlink profile?
Greetings, I am utilizing link tracking list to keep a track of 301 redirect backlinks to my main site because these links do not as yet show up in my backlink profile on Moz. Will adding these to the tracking list with the redirected domain as the target / source url show up in my main site backlink profile eventually?
Link Explorer | | AkiedoFung0 -
OSE 'request CSV' for links blank
After doing the link check on a domain, got 40 or so links. Clicked Request CSV The file that is downloaded contains no links. The column headings are there but no content Did this twice and got same blank file. OSE is showing the 40 links
Link Explorer | | cbpayne0 -
Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer?
Internal Equity-Passing Links not getting crawled in Moz Open Site Explorer. What is the cause of this? We've checked the robots.txt and htaccess file, but so far we can't find anything that would be blocking Moz from crawling the internal links. We manage loads of other clients on this platform and this is the first time we've run into this issue. What else can I check?
Link Explorer | | OozleMedia0 -
When Will the OSE Index Increase in Size
It's an amazing tool and the rest of Moz Pro is excellent, but the index is just so small. Does anybody know when we can expect it to increase?
Link Explorer | | Edward_Sturm0 -
Just Discovered Links Are Down for ~2-3 Days
UPDATE 12/01/15: This issue is now resolved and Just Discovered Link data is back. Sadly, I've got bad news. Due to an error we made (literally a typo on a curl command), Just Discovered Links in Open Site Explorer will be unavailable for 2-3 days. The data was actually lost, but we're re-indexing all those links now and they should be back in working order by Monday. NOTE: this only affects link counts and links listed in the "Just Discovered" sections of OSE. No links in the main index nor any metrics (PA/DA/etc) are affected. Our sincere apologies - we're going to build mechanisms to prevent this for the future.
Link Explorer | | randfish3 -
OSE - Link Opportunities
I'm checking out this new Link Opportunities feature for one of our sites and what I'm seeing right now is pretty disappointing. For Reclaim Links, everything listed is an internal link on our site. It's got tons of URLs from our old Iciniti structure (replatformed to Magento mid-March). It's crawling tons of stuff that's blocked in robots. There are no links from external domains in the first 5 pages. For Unlinked Mentions, it's showing tons of mentions - 33,566 to be exact, a ridiculous number - mostly from news sites like Forbes, WSJ, Guardian, CNN, etc. These sites are not mentioning us. It's set up to look only for our brand name or domain name, so I don't know how it's thinking there are all these nonexistent mentions. What's going on with Link Opportunities?
Link Explorer | | Kingof50 -
Open Site Explorer doesn't show local directories or citation links?
Why is it that when I run a link analysis for my local business sites I don't see any links from Yelp, Google+, Facebook, any local citations? Regardless of them being follow or no follow isn't the hyperlink to a website from a Yelp profile considered a link? Same with any other local business directory? I know the company is listed on a few dozen because I can see it manually but it's not showing up in Moz? Why is it that all local directories and citations with website are omitted? And since it is not there, where is a good place to go to discover these things? I have tried whitespark. It was okay but honestly I wasn't terribly impressed. The data was good, the UI was just okay, but with smaller clients it was an initial check and then very occasional checks that needed to happen. We would go months without using it.
Link Explorer | | bricegump0