What user agent is used by SEOMOZ crawler?
-
We have a pretty tight robots.txt file in place to only allow the major search engines. I do not want to block SEOMOZ.ORG from being able to crawl the site so I want to make sure the user agent is open.
-
Hi Eric,
The useragent of SEOMoz is: rogerbot.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Meta no index crawler warnings
I've decided that the duplicate content issues on my site weren't worth the effort from the amount of traffic the archive pages on my WordPress site received no I decided to no-index them using Yoast. Now I have 60 meta no-index crawler warnings. Should I just ignore these? It seems I get warnings, either way, I use the site. Does anyone have advice on how to move on with this?
Moz Pro | | Libra_Photographic0 -
Key words that my target segment uses
Using SEOMoz (or what other tools do you recommend), how can I find the most common key words that my target segment uses in Google search - about any subject? Say my target segment of customers is teens aged 13-18 in Mexico (using Spanish) or in Turkey (using Turkish language). Thank you in advance 🙂
Moz Pro | | Cenktukel0 -
Seomoz legacy pages?
Hello, I am finding that I miss several of the old seomoz sections. The legacy tools in particular like the visual website comparison. Where is that now? Also, where is the ongoing list of the top 100 sites? So much was lost in the shift to MOZ, I hope some of the good old stuff is still available. Thank you, Nolan
Moz Pro | | QuietProgress0 -
Why is SEOmoz link tagged with a (nofollow) for my site? I have tried to write a youmoz post a couple of times. But, I am just not an expert, that is why I am on SEOmoz.
Why is SEOmoz link tagged with a (nofollow) for my site? I have tried to write a youmoz post a couple of times. But, I am just not an expert, that is why I am on SEOmoz. Is there something I can do to get juice from my SEOmoz account? (nofollow) Scott McNelley, President: Admiral Movers, Admi... www.seomoz.org/users/profile/423056
Moz Pro | | Smcnelley0 -
Video SERP and Seomoz ranking
It seems that my keywords that lead to videoresults in SERP, is not being ranked on Seomoz! How come when i rank #3 on a certain keyword with a videoresult Seomoz is displaying me as #15 (which is the second of my pages in SERP)? What is the reason for not counting the video-result in the ranking-tool?
Moz Pro | | alsvik0 -
SEOMoz SERP Overlay Vs. Opensite Explorer
This may be a simple answer, but when I search for a term and see a website on the SERP, the SEOMoz tool bar shows link data beneath the link. For this site in particular, it shows 300+ links for the root domain and for the page, it shows 8 links. When I put that website in opensite explorer, it shows the same data for the "Page" stats (8 links from 3 root domains), but nowhere can I find where the 315 links from 4 domains comes from. So my questions is why do those links show in the SERP overlay, but not in OSE? il5y9.png
Moz Pro | | GetFoundFirst0 -
Why is the crawler following form action links?
I have an issue with one of my sites where the SEOMoz crawler is following some form action links. It is my understanding that the crawler will ignore these links. Why would it not be ignoring them in certain cases. If you need more detail, please ask. Thanks.
Moz Pro | | AmberHanson0 -
How do you use mozMetrics
How does everyone use the mozMetrics (mozRank, mozTrust, Domain Authority, Page Authority) with their clients? Do they ask you what these metrics mean and if so how do you explain it to them?
Moz Pro | | caseyhen1