What's name of SEOmoz and Open Site Explorer robots?!
-
I would like to exclude in robots.txt SEOmoz and Open Site Explorer bots to don't let them index my sites… what's their names?
-
The information you've requested is found on the following link: http://www.seomoz.org/dp/rogerbot
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Opens Site Explorer sees two pages that are one
www.mysite.com/ and www.mysite.com/default.asp are both showing up in open site explorer. How do I make sure that these are not being interpreted as two pages when they are the same page? (Both in search engines and OSE.)
Moz Pro | | EugeneF0 -
Site Explorer shows links as followable but they have nofollow tags
Hello, I am looking at site explorer and sites linking to my site moneyfact.co.uk. I've got thousands of links showing as 'followable' but when i check them they have rel="nofollow" tags. e.g: http://www.dianomioffers.co.uk/partner/moneyfacts.co.uk/brochures.epl?partner=93&partner_id=93&partner_variant_id=33 Why would they show as followable when the links are nofollowed? Thanks Steve
Moz Pro | | SteveBrumpton0 -
Open site explorer result discrepancy
Hi all, I'm a little confused - when using open sites explorer to view of link stats on one of our competitors site I get conflicting results. For example - Page Specific Metircs shows the url www.xyz.com has 265 external links. But Root Domain Metrics show they have 22,687 links Yet the total links at the top of the report says Total links 999 Can someone explain why www.xyz.com has 265 external links and the rot domain (which is the same) has 22687 links? I've also run the report on xyz.com rather than www.xyz.com which yielded no results. Thanks in advance
Moz Pro | | EclipseLegal0 -
What software can I use on my Mac to open and read a SEOMoz CSV exported file?
I do not want to buy XL or Pages just to read the CSV from SEOMoz. So I bought an app on the AppStore... and this app is unable to read the CSV from SEOMoz. Since I already wasted $2, Id rather avoid to waste more (and avoid that to others too!). What software is recomanded to open these CSV files? Also, I tried Google Docs, but I bumped in their 400K cells limit 😞
Moz Pro | | jgenesto0 -
Why does SEOMoz crawler ignore robots.txt?
The SEOMoz crawler ignores robots.txt It also "indexes" pages marked as noindex. That means it is filling up the reports with things that don't matter. Is there any way to stop it doing that?
Moz Pro | | loopyal0 -
Fetch googlebot for sites you don't own?
I've used the "fetch as googlebot" tool in Google webmaster tools to submit links from my site, but I was wondering if there was any type of tool or submission process like this for submitting links from other sites that you do not own? The reason I ask is, I worked for several months to get a website to accept my link as part of their dealer locator tool. The link to my site was published a few months ago, however I don't think google has found it and the reason could be because you have to type in your zip code to get the link to appear. This is the website that I am referencing: http://www.ranchhand.com/dealers.php?zip=78070&radius=20 (my website is www.rangeroffroad.com) Is there any way for Google to index the link? Any ideas?
Moz Pro | | texmeix0 -
How often are open site explorer reports updated?
I collect the information contained in open site explorer reports and csv backlinks audits on the 15th of every month. I noticed that the numbers are unchanged from 9/15-10/15. How often are the reports typically updated?
Moz Pro | | seagreen0 -
When using Wordpress, why does it show up so many meta data errors on here and on google webmaster? A list of do's would be good?
Using wordpress is a good CMS, yet there sre so many meta data errors occuring, is there a list of what to look out for and good practices when using wordpress?
Moz Pro | | CosmikCarrot0