What user agent is used by SEOMOZ crawler?
-
We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
-
Hi Eric,
The useragent of SEOMoz is: rogerbot.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Anyone using Yahoo Small Business? Not sure if SEOmoz works with YahooSB
I am not sure if SEOmoz is compatible with Yahoo Small Business. The crawl states that the title page is too long for over a hundred titles, but they are not. SEOmoz is taking the title page and the parent or catagory page and grouping together. Please only respond if you work SEO for Yahoo Small Business accounts. Would be glad to take discussion thread off line or show the SEOmoz report.
Moz Pro | | Wales0 -
Is there anything like SEMRush in SEOMoz?
I'm new to SEOMoz and trying to find something like SEMRush for finding what keywords competitors use. Is there anything like that within SEOMoz?
Moz Pro | | seanuk0 -
Seomoz suggetions implemented but keyword rankings dropping.
We have been with SEOMOZ for just a couple of weeks now. We impemented all the recommendations made in page analysis and crawl errors but since making changes we have started to fall in ranking for these keywords. Should we undo all his work or sit it out. Why would our rankings fall if these changes are for the better ? Thanks
Moz Pro | | Yorkie0 -
How long does the seomoz crawl take?
It's been doing it's thing for over 48 hours now and Ive got less than 350 pages... is this norma? It's NOT the first crawl.
Moz Pro | | borderbound0 -
Http://lsapi.seomoz.com pop up
I am getting this pop up on every page I visit: A username and password are being requested by http://lsapi.seomoz.com. The site says: "SEOmoz" I've searched some forums and see that others are experiencing it as well. The advice was to log into my seomoz account, however that did not work...any ideas?
Moz Pro | | texmeix0 -
SEOmoz Q&A down last few days
It seems the Q&A section had some issues since the 25th. Users could post new Q&As but they were not visible to most users. Roger was caught slacking! The issue appears to be resolved at this time. I just wanted to share to anyone who asked a question the past few days who did not receive a response you may wish to repost your question as many readers will not go back and check questions from prior days.
Moz Pro | | RyanKent1 -
SEOMoz Campaign Tool
I've noticed that when looking at the SEOmoz tool, specifically the On Page analysis tool, it is still looking at an old url. About two months ago I made updates to all of our category page URLs. Previously the old urls were stuffed with keywords, strange characters and were really long. When looking at the on-page tool though it is referencing the old urls for keywords and I'm wondering why? I figure its been long enough to recognize the new urls. Is the paring of a keyword and a url saved and just graded on a weekly basis to produce the report? I had expected to see the new url's by now which are also represented in the sitemap. Around that same time I also added our TellAFriend Page and Review pages to our Robots.txt file as not to be crawled but I still see these pages come up in the errors report. Should this update as well?
Moz Pro | | dgmiles0 -
SEOmoz toolbar log in chrome wonky!
In Chrome, I'll start off not logged in to the toolbar. I'll click log in which forwards me to the SEOmoz login page. I'll login. Sometimes the toolbar will reflect this login and the metrics will poplulate in the PA and DA, other times it won't. If I navigate to another page within the same tab, it may show metrics still, but it is also just as likely to show that I'm not logged in. If I open a new tab, the toolbar will show that I'm not logged in. I click the log in again but when directed to SEOmoz, it'll show that I'm already logged in. I haven't been able to pinpoint exactly when it'll work and when it won't. Seems a bit random, so am wondering if anyone else has experienced this issue and has been able to solve this logged in / not logged in problem. As a note, anytime I navigate back to the SEOmoz site, whether by opening a new tab or a new window, the SEOmoz site does show I'm logged in, while the toolbar shows I'm not. You can see a demonstration of the simultaneous logged in SEOmoz site and logged out SEOmoz toolbar in the attached screen shot. UPDATE Also having similar issues in firefox. Am wondering if this has anything to do with the fact that I changed my email address within the past few weeks. KQXxN.gif
Moz Pro | | gregalam0