Can we add sites to the crawl queue for OSE?
-
Is it possible to request that Open Site Explorer crawls a new URL on its next run?
This tool is the first place I go to when working on a new site, and when there is "No Data Available" this is a little frustrating.
I fully appreciate that this lack of data is usually a signal that the website is either very new or of low quality, however that if often the reason that I am brought in and would very much like to benchmark and provide initial analysis using this tool.
It would make sense that OSE crawls the sites that Moz members are working on wouldnt it?
Scott.
-
Hi Scott,
Derek and Brad are correct in that there's no real way to tell Roger to index a specific page.
Your best bet to get your page index in OSE is to work at building quality backlinks and making sure your site is configured properly so we can reach your pages.
Also remember you can set up your campaign for your site and crawl it that way if you want to evaluate the rest of your page information.
I hope that helps.
Cheers,
Joel. -
You "ask it what it knows" when you type in a URL and hit Search. Think of it like walking up to a really smart person and asking them to list off every book every written that includes the word "rhinoceros." They can only list the books they've read. A person only has so much time for reading, and OSE only has so many resources for crawling the web. It will never get everything.
If OSE doesn't show any backlinks for a URL, it means it didn't see any backlinks in the portion of the web that it crawled. That might mean there are no backlinks at all, or it might mean the backlinks are yet undiscovered (probably because they're in an obscure corner of the web). The best suggestion is to use multiple tools, as Derek says below.
-
SeoMoz members have no control over what Mozbot crawls. Your best bet is to use a variety of site explorers to find links. Ex. Majestic, Google Webmaster tools, Link:www.example.com, Bing Link Explorer
-
Yes I know what you mean here, but if there is any way to "point" the crawl engine at the site and ask it what it knows?
I hadnt thought about it from that perspective, just asking the question to see what is possible to try and get more data if it can be got?!
-
As far as I know, crawling your website wouldn't accomplish anything. OSE would need to crawl the pages that link to your website. And if you knew what those were, you wouldn't need OSE, right?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
One of my sites fell off the earth
I manage a handful of sites and have ranked top 5 for a handful of keywords for a long time. I recently checked one of my clients websites and other tier 2 pages will come up but the home page is now not showing up for any listings on Google. Was there a recent update was I put in the mysterious sandbox? I have not modify anything or using any black hat seo tricks. Only thing that was done is the client installed demand force onto their website. Any feedback about an update or about demand force or issue would be helpful. The site is https://www.nwichiropractic.com/
Moz Pro | | Tylerr19850 -
I need an interlinking report for my site, is there a report in Moz or another application that tell me how all of my pages are linked to other pages on my site?
I am in the process of doing a redesign for one of my sites. I need an interlinking report for my site. Is there a report in Moz or another application that tell me how all of my pages are linked to other pages on my site?
Moz Pro | | seoflorida0 -
Have a Campaign, but only states 1 page has been crawled by SEOmoz bots. What needs to be done to have all the pages crawled?
We have a campaign running for a client in SEOmoz and only 1 page has been crawled per SEOmoz' data. There are many pages in the site and a new blog with more and more articles posted each month, yet Moz is not crawling anything, aside from maybe the Home page. The odd thing is, Moz is reporting more data on all the other inner pages though for errors, duplicate content, etc... What should we do so all the pages get crawled by Moz? I don't want to delete and start over as we followed all the steps properly when setting up. Thank you for any tips here.
Moz Pro | | WhiteboardCreations0 -
So noob while adding competitors, why i can't add sub-directory or specific url?
I try to add my competitors but failed, but there is only sub domain we can add to competitors, so how can i add a sub-directory or specific url to my competitors?
Moz Pro | | lfproseo0 -
What's Happened To OSE's External Links For My Site?
Hi, I'm just taking my first steps with Open Site Explorer. I've hit a problem that I'd be really grateful for some help with. I'm running a website (that I didn't create) and want to get a clear picture of the inbound links. When I enter the URL into the OSE search bar, there are no external domains listed under the 'Inbound Links' and 'Linking Domains' tabs. Only internal site links are registered. Setting the filters, "only external" + "pages on this root domain", under the Inbound Links tab, does bring up a list of external sites. But I haven't had to enter filters just to see a list of inbound links with any other sites. Also, the breakdown under the Linking Domains tab remains the same - only links within my site are shown. Does this ring a bell? Any ideas what I might be doing wrong, or what might be wrong with my site to cause this problem? Cheers for helping, Josh
Moz Pro | | JoshAustin460 -
How long is a full crawl?
It's been now over 3 days that the dashboard for one of our campaigns shows "Next Crawl in Progress!". I am not complaining about the length... but I have to agree that SEOMoz is quite addictive, and it's quite frustrating to see that everyday 🙂 Thanks
Moz Pro | | jgenesto0 -
Can Open Site Explorer Do This?
Is there any way to set up Open Site Explorer to show these things for competitor external backlinks: Google Page Rank of the page the backlink is on Google Page Rank of the domain the backlink is on Whether the backlink is a follow or no follow Is this possible in OSE? If not, are there any other SEOMOZ Tools that will do this? Thanks.
Moz Pro | | N5c0 -
How to crawl the whole domain?
Hi, I have a website an e-commerce website with more than 4.600 products. I expect that Seomoz scan check all url's. I don't know why this doesn't happens. The Campaign name is Artigos para festa and should scan the whole domain festaexpress.com. But it crels only 100 pages I even tried to create a new campaign named Festa Express - Root Domain to check if it scans but had the same problem it crawled only 199 pages. Hope to have a solution. Thanks,
Moz Pro | | EduardoCoen
Eduardo0