What user agent is used by SEOMOZ crawler?
-
We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
-
Hi Eric,
The useragent of SEOMoz is: rogerbot.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEOMoz Question
Hi, I have taken over SEO on a real estate site with an internal blog. Unfortunately there are loads of duplicated pages and titles in the blog. It was suggested that all should be rel=canonical so not to show up. In my last crawl here though they still do. So question is if SEOMoz crawls and sees them is Google also seeing them? Also would it be best to move the blog off site so this does not cause anymore damage and just link to it from the main site? Thanks for your comments
Moz Pro | | AkilarOffice0 -
How do YOU use site explorer?
I normally use open site explorer to identify links that competitors of my clients have and sometimes this gives me what I call 'some low hanging fruit' to go after. (and of course links that are more challenging to get) I don't know why this didn't occur to me sooner. If my client is a chiropractor why not look at the links for 50 or 100 of the top rankings chiropractic sites all over the US? This would HAVE to uncover a wealth of blogs to comment on that have good authority, great industry associations, publications, forums - a whole wealth of items. It made me wonder how many people use site explorer like I have been (top 3-4 competitors that your client has) or identifying links pointing to LOTS of competitors? How do you use it? Couldn't you almost base an entire link building campaign using OSE? Why would this be a bad idea if not? Just some random thoughts. THE WEEKEND IS ALMOST HERE - Have a great day everybody! 🙂
Moz Pro | | Mrupp441 -
Learn SEOmoz API (and more)?
I'm sorry for this very basic question. The reason why I'm asking is that I wan't to start to use SEOmoz API (and later on Majestic SEO etc.) I have search on the web about API in general, SEOmoz specifically, in Q&A and asked around but:
Moz Pro | | OscarSE
I really can't get my head around what "set of skills" I need to know to be able use the SEOmoz API? And other APIs for that reason. Do I need a programming skills, or just knowledge how each specific API works(+ common sense)? Or both? I'm sorry if this is off topic but the main reason why I'm asking is that I wan't to start to use the SEOmoz API. If you could provide a link or two about where I can start to learn about how this works, I would really appreciate that!0 -
Sharing/Transferring SEOMOZ campaigns
What happens when you are no longer working on a campaign, and your client needs the campaign history? I don't pay for my account, my employer does. If I ever have to move on what should I do with the account? I would want to keep my seomoz profile and Q&A history. But the campaigns belong to my employer so I would have to change all of the profile settings into his name… Is there a protocol for this kind of situation?
Moz Pro | | BeTheBoss0 -
How reliable is SEOMOZ data?
I have been using the Mozbar data to locate Auth websites, basically the higher the DA/PA the better it is. If I then check the site out and they have good load times, lots of social sharing etc this makes it extra special and now a good site to try and get a link on. I found 3 blogs to guest post on which all have DA/PA 80+ some of the blogs have a PR7. Now this is great but what scares me is have I just wasted 3 guest posts because the data is incorrect. These blogs are run by 1 person and the kind of work involved to achieve those stats would be very heavy. Maybe this blogger has just hit the nail on the head with SEO and link building. Input anyone?
Moz Pro | | activitysuper0 -
Do you miss SEOmoz's Term Extractor Tool?
Do you miss SEOmoz's Term Extractor Tool and want them to bring it back? If you do, please go to this link and submit a feature request form. Here is a brief description for those that are not familiar with what the SEOmoz Term Extractor Tool is;This tool analyzes the content of a given page and extracts the terms that appear to be targeted at search engines. It applies certain weights to HTML elements and other on-page factors to determine what it thinks is a targeted term.
Moz Pro | | brianhughes1 -
Seomoz research tools question for inbound links
What is the best seomoz tool and or indicator within a tool for checking on a link (directory or article site) to evaluate whether or not you would actaully want a link from them? Any way to see if google penalizes them for there tactics or if that can hurt me by them linking to me or whatever? I am at the beginning of a link building mission, but want to ensure that I do it methodically and correctly as possible based on the combines wisdom of this community. Thanks for your help, Steven
Moz Pro | | sfmatthews0
