How effective is OSE in crawling press release links?
-
How effective is OSE in crawling press release links?
We have released a few press releases recently (over the last couple of months) and OSE doesn't seem to have found them.
-
Hey There,
That could be a possibility. It is hard to say definitively given the nature of web crawlers. They just crawl links as they see them in random succession, so a lot of factors come into play.
Best,
Nick
SEOmoz -
Our releases have appeared on big sites like the Financial Post.
Is it possible they just get buried under other news so OSE can't find them? I know Google indexes these pages, we get the alerts.
-
Hey there,
Just so you know, here's how we compile our index: - We grab the most recent index. - We take the top 10 billion URLs with the highest MozRank (with a fixed limit on some of the larger domains). - We start crawling from the top down until we've crawled 59,000,000,000 pages (which is about 25% the amount in Google's index).
Therefore, if the site is not linked to by one of these seed URLs (or one of the URLs linked to by them in the next update) then it won't show up in our index. Sorry!
We update our Linkscape Index every 4 weeks. Crawling the entire Internet to look for links takes 2-3 weeks, but our crawlers are always in motion. When we need to start processing, we grab all the data they have collected and start processing which can take up to 3 weeks to determine which of those links are the most important. You can see our most recently updated schedule here: http://seomoz.zendesk.com/entries/345964-linkscape-update-schedule
Linkscape focuses on a breadth-first approach. Therefore we almost always have content from the homepage of websites, externally linked-to pages, and pages higher up in a site's information hierarchy. However, deep pages that are buried beneath many layers of navigation are sometimes missed and it may be several index updates before we catch all of these.
If our crawlers or data sources are blocked from reaching those URLs, they may not be included in our index (though links that point to those pages will still be available). Finally, the URLs seen by Linkscape must be linked-to by other documents on the web or our index will not include them.
For now, the best thing you can do to help your domain become indexed is to work on link building for links from sites with high mozrank.
Best,
Nick
SEOmoz -
This all depends on where the press releases have been posted.
If you've got the urls of the sites they're on it may be worth looking at these in OSE to see if SEOmoz has them indexed. However, don't forget that the SEOmoz index is not the same as google's. Just because it's not showing on OSE doesn't mean that G hasn't seen it.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Crawl errors for pages that no longer exist
Hey folks, I've been working on a site recently where I took a bunch of old, outdated pages down. In the Google Search Console "Crawl Errors" section, I've started seeing a bunch of "Not Found" errors for those pages. That makes perfect sense. The thing that I'm confused about is that the "Linked From" list only shows a sitemap that I ALSO took down. Alternatively, some of them list other old, removed pages in the "Linked From" list. Is there a reason that Google is trying to inform me that pages/sitemaps that don't exist are somehow still linking to other pages that don't exist? And is this ultimately something I should be concerned about? Thanks!
Reporting & Analytics | | BrianAlpert780 -
Why is my Technorati link no longer showing?
Hi, i had a Technorati link as my lop link showing in SEOmoz. its no longer showing. I verified that the blog is still listed with them. Does anyone know why that link is not in the campaign...or showing up in site explorer? Thanks, Kevin
Reporting & Analytics | | yandl0 -
Tracking clicks from a specific link
Hi all, I'm looking for a bit of help with Analytics. I want to track the number of clicks that my main CTA generates over the course of the month. I've got all my goals set up correctly, but is there some sort of code that I can add to that specific link which will count the goal conversions which it generates? Do I need to set up something specific in GA? Thanks a lot for your help,
Reporting & Analytics | | theshortstack0 -
Do links with tracking codes pass PageRank?
I have a client that has acquired a link from an influential partner but the partner has set the link up to have clicks tracked within their analytics. Do links like this pass PageRank: Anchor Text
Reporting & Analytics | | SearchEngineRescue0 -
Pages crawled
Hi I've created a campaign for my own website and added 3 competitor sites. Under the campaign it says that 53 pages have been crawled but my site has less than 10 pages. Are the other pages from my competitor sites? Thanks James
Reporting & Analytics | | avecsys0 -
Links are not found in OSE or am I missing ?
Hi.. All of our targeted pages have gone through serious Blog Posting and Social Bookmarking. All the sites were more than PR1 or 2 and all of them had a dofollow link with the perfect anchor texts. But when I trying to check our pages on OSE, it doesnt any of them. Why is that ? Im getting worried now. We have spent our last 7 months on this .
Reporting & Analytics | | qubesys0 -
Google +1 and ranking effect .
Anyone have any experience as to what effect google +1 has on ranking? Trying to figure out what impact it might have. Ecommerce site in norway selling childrens clothing. Atm we are ranking 25th for main targetted word childrens clothing (barneklær in norwegian). on google.no this has a difficulty of 34. None of main competitors have any amount of google +1's on their site. Lets say if I in some way could manage to get 100 ppl to push +1 button. Would this affect our ranking at all ? Might be impossible to answer but if anyone has thoughts about it I am interested. Thanks
Reporting & Analytics | | danlae0 -
High percentage of nofollow links
Hi, I've just created my first campaign and noticed that on the competitive analysis our website is having a lot of nofollow links: more than 50% I did some research on the web to learn more about nofollow links, but I don't understand why this percentage is so big especially compared to the other websites in the analysis (less than 10%)? Anyone any ideas? Thanks!
Reporting & Analytics | | poupette0