What user agent is used by SEOMOZ crawler?
-
We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
-
Hi Eric,
The useragent of SEOMoz is: rogerbot.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Not provided Data in SEOMoz reports
Hi How do SeoMoz reports deal with 'not provided' data I see my total visits from organic search for a month are same as total of both my branded and non branded keyword traffic combined yet GA is reporting 157 visits from non provided data so is SEOMoz being very clever and finding a way to decipher this not provided data and allocate it accordingly in the reports ? Or if not what ? Many Thanks Dan
Moz Pro | | Dan-Lawrence0 -
What is the logarithmic scale used for domain authority?
I want to quantify how much better a score of 80 is compared to 60. Or 60 compared to 30 etc.... What is the logarithm base? Thanks, Rik
Moz Pro | | garypropellernet0 -
What keywords should I use in my campaign.
I am a chiropractor. I only compete against web sites in my town. Should my key words be neck pain, back pain? Or should it be neck pain Bloomington Illinois and low back pain Bloomington Illinois? I am referring to the campaigns I just started. (I am new)
Moz Pro | | Bob550 -
Reset Crawler
Hello, Does anyone know how to reset the crawler? We recently uploaded our new website and deleted the current campaign but it seems the crawler is caching our old websites data and not the new so every time we try to create a new campaign with the same details, it's just pulling everything from cache it seems. Thanks
Moz Pro | | ForzaHost0 -
Can SEOMOZ do Local SEO ?
Most of our clients are local but we can not get local or regional (for example VA State or Washington DC) SERP results within SEOMOZ. it would be nice to create custom search profiles based on region (State or County) and track SERP within SEOMOZ. Ranking reports and even keyword difficulty analysis etc. within SEOMOZ are misleading for local web sites. SEOMOZ default site setup assumes every business doing SEO serves all over the US. I think it will be very beneficial if we have a choice to select State or County of local web sites during initial campaing set up at SEOMOZ. what do you think? do you know any work around of this problem? Thanks,
Moz Pro | | CertifiedSEO
Lewis2 -
New To SEOMOZ, 2 Questions...
Hi, 1. I got signed up with SEOMOZ yesterday and would like to know about the competitive analysis tool. I saw in a demo video of SEOMOZ that there was an aspect of Social links (Facebook etc) included in the analysis, I can't see this in my analysis however. 2. Is it possible to change websites over time? Let say in a few months I want to work on a new website, can I remove one of my 5 and add a new one? Thanks! James
Moz Pro | | James10 -
SEOmoz vs Google Webmaster Tools on incoming links
I'm working on basic SEO for http://queueassoc.com. Google has indexed the non-www verions of the pages and these are what the SERPS return SEOmoz toolbar shows that all of the incoming links juice goes to the www. versions of the pages, none to the non-www version. Yesterday I set up GWMT for the site, submitted a sitemap with the www version of the pages and set the default address to the www version. I had to verify both versions of the site in order to do this and in looking at the non-www version I saw that Google had all the incoming links there and none in the www.version, the opposite of what SEOmoz shows. Is this just because Google only has the non-www versions in its index? Will they show the links to the www version once they get them in the index? I'm worried about losing Google Page Rank value or SEOmoz DA by making this switch.
Moz Pro | | bvalentine0 -
SEOmoz metrics vs Panda Algorithm
Hey SEOmoz guys, My question is simple. Have you re-test your metrics (DA, PA, mR etc) correlation with SERPs in google panda update? are they still valid in determining authority, trust and popularity in panda update? are they still usefull? Thanks! Yudhis
Moz Pro | | yudz0