Can we add sites to the crawl queue for OSE?
-
Is it possible to request that Open Site Explorer crawls a new URL on its next run?
This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating.
I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool.
It would make sense that OSE crawls the sites that Moz members are working on wouldnt it?
Scott.
-
Hi Scott,
Derek and Brad are correct in that there's no real way to tell Roger to index a specific page.
Your best bet to get your page index in OSE is to work at building quality backlinks and making sure your site is configured properly so we can reach your pages.
Also remember you can set up your campaign for your site and crawl it that way if you want to evaluate the rest of your page information.
I hope that helps.
Cheers,
Joel. -
You "ask it what it knows" when you type in a URL and hit Search. Think of it like walking up to a really smart person and asking them to list off every book every written that includes the word "rhinoceros." They can only list the books they've read. A person only has so much time for reading, and OSE only has so many resources for crawling the web. It will never get everything.
If OSE doesn't show any backlinks for a URL, it means it didn't see any backlinks in the portion of the web that it crawled. That might mean there are no backlinks at all, or it might mean the backlinks are yet undiscovered (probably because they're in an obscure corner of the web). The best suggestion is to use multiple tools, as Derek says below.
-
SeoMoz members have no control over what Mozbot crawls. Your best bet is to use a variety of site explorers to find links. Ex. Majestic, Google Webmaster tools, Link:www.example.com, Bing Link Explorer
-
Yes I know what you mean here, but if there is any way to "point" the crawl engine at the site and ask it what it knows?
I hadnt thought about it from that perspective, just asking the question to see what is possible to try and get more data if it can be got?!
-
As far as I know, crawling your website wouldn't accomplish anything. OSE would need to crawl the pages that link to your website. And if you knew what those were, you wouldn't need OSE, right?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
I need an interlinking report for my site, is there a report in Moz or another application that tell me how all of my pages are linked to other pages on my site?
I am in the process of doing a redesign for one of my sites. I need an interlinking report for my site. Is there a report in Moz or another application that tell me how all of my pages are linked to other pages on my site?
Moz Pro | | seoflorida0 -
How many competitors can you track?
Hi All, How many competitors can you track in a campaign? It appears to only allow 3 competitors. Thanks,
Moz Pro | | toby-02
Toby1 -
Bulk OSE Open Site Explorer Tool?
I am trying to do some spring cleaning for a client and hoping to prune any unnecessary domains. Is there a tool that will check, in bulk, these domains through Open Site Explorer? I've looked through all the different Excel spread sheet apps and google doc apps but they are incredibly buggy if they work at all since SEOmoz changed their data limits. Maybe a new tool has been updated in the last few months that I am not aware of. Thanks!
Moz Pro | | kerplow0 -
Discrepancies in link reports from SEOMoz and OSE
Hello, I am trying to understand the link profile of my site. In the competitive analysis from SEOMoz, it shows 22K+ of links, with about 900+ being external followed links and 800+ internal. Webmaster tools shows a similar number of external followed links, but the link report from OSE only shows about 150 external followed links. This brings up several questions: Where is this 22K total links coming from? Why is there such a difference in the SEOMoz competitive analysis and the OSE report? Why does the OSE report show some links as not followed, while Webmaster tools lists them as followed? Am new to the off-page aspects of SEO, and I have to say the discrepancy in data from different tools is by far the most challenging thing for me. Would welcome general advice on this topic as well. Thank you!
Moz Pro | | LynnMarie0 -
Crawl test tool from SEOmoz - which URLs does it actually crawl?
I am using for the first time the crawl test tool from SEOmoz and I do not really understand which URLs the tool is going to crawl. First, it says "enter any subdomain" --> why can´t I do the crawl for the root domain? Second it says "we'll crawl up to 3,000 linked-to pages" --> does that mean that the tool crawls all internal links that it can find on the given domain? Thanks for your help!
Moz Pro | | Elke.GetApp0 -
Where can I post jobs at?
Where can I post a job at? http://slingshotseo.myexacthire.com/ViewJob-32983.html
Moz Pro | | PapaRelevance0 -
Canonical tags and SEOmoz crawls
Hi there. Recently, we've made some changes to http://www.gear-zone.co.uk/ to implement canonical tags to some dynamically generated pages to stop duplicate content issues. Previously, these were blocked with robots.txt. In Webmaster Tools, everything looks great - pages crawled has shot up, and overall traffic and sales has seen a positive increase. However the SEOmoz crawl report is now showing a huge increase in duplicate content issues. What I'd like to know is whether SEOmoz registers a canonical tag as preventing a piece of duplicate content, or just adds to it the notices report. That is, if I have 10 pages of duplicate content all with correct canonical tags, will I still see 10 errors in the crawl, but also 10 notices showing a canonical has been found? Or, should it be 0 duplicate content errors, but 10 notices of canonicals? I know it's a small point, but it could potentially have a big difference. Thanks!
Moz Pro | | neooptic0 -
Question about when new crawls start
Hi everyone, I'm currently using the trial of seomoz and I absolutely love what I'm seeing. However, I have 2 different websites (one has over 10,000 pages and one has about 40 pages). I've noticed that the smaller website is crawled every few days. However, the larger site hasn't been crawled in a few days. Although both campaigns state that the sites won't be crawled until next Monday, is there any way to get the crawl to start sooner on the large site? The reason that I've asked is that I've implemented some changes that will likely decrease the amount of pages that are crawled simply based upon the recommendations on this site. So, I'm excited to see the potential changes. Thanks, Brian
Moz Pro | | beeneeb0