Do the SEOmoz Campaign Reports follow Robots.txt?
-
Hello,
Do the SEOmoz Campaign Reports (that track errors and warnings for a website) follow rules I write in the robots.txt file?
I've done all that I can to fix the legitimate errors with my website, as reported by the fabulous SEOmoz tools. I want to clean up my pages indexed with the search engines so I've written a few rules to exclude content from Wordpress tag URLs for instance.
Will my campaign report errors and warnings also drop as a result of this?
-
Thanks Chris and Sam. The confirmation and additional resources helped.
-
Hi,
Rogerbot does adhere to your robots.txt file as mentioned here under the section heading How come rogerbot isn’t crawling all of my pages?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Organic search visits in SEOMoz reporting
hi Are the organic search visit figures in SEOMoz traffic reporting unique or total visits ? cheers dan
Moz Pro | | Dan-Lawrence0 -
Report is showing 2 different domains?
Hello SEOMOZ Fam, I am trying to get a understanding on what is the best method for me to do moving forward. I am just noticing that my reports are showing data for both http://domain & http://www.domain which is what has been confusing me for this whole past month. I have just went into my control panel and redirected domains to be just http://domain....will me doing this redirect clean up my next crawl report next week or are there other steps I need to do with my domain or even my campaign? I think I chose root level for my campaign setting. Thanks so much n advance
Moz Pro | | 41global0 -
Can I add another user to my SEOMoz Pro campaign?
I have a couple of campaigns on my SEOMoz Pro account and I would like to give access of one of theses campaigns to a SEO consultant, is that possible? Or do I need to give access to my full SEOMoz account?
Moz Pro | | bernardovailati3 -
Confused on setting up my domain in a campaign
I have a website that is www.example.com. When I first setup my campaign in SEOMoz, I missed the instructions that stated I need to set up my domain as it appeared in the browser. Thus, I set it up as example.com. When I realized my mistake, I setup a second campaign as www.example.com and am running them side by side to see the differences. My question has to do with the best setup. I have a blog that is a subdomain as blog.example.com. It appears that the www.example.com campaign is not crawling the blog pages but example.com is. Are there any downsides in setting up this campaign as example.com? I have a number of other sites with the same issue so would like to get this resolved before I setup the additional sites. Thanks for any assistance or insights into ways I may be "shooting myself in the foot" with the wrong domain structure in my campaign settings.
Moz Pro | | rfwood0 -
SEOMoz reports and 404 errors
My SEOMoz report shows a 404 error, found today for this url: http://globalheavyhaul.com/google.com i do not have this anchor text anywhere on my website. How did Roger figure out that somebody looked for that page? Do I need to worry about 404 errors that are the result of user mistakes, instead of actual bad links?
Moz Pro | | FreightBoy0 -
Getting your site totally indexed by SEOMOZ
Hi guys! Ijust started using SEOMOZ software and wondered how it could be that my site has over 10.000 pages but in the Pro Dashboard it only indexed about 1500 of them. I've been waiting a few weeks now but the number has been stable ever since. Is there a way to get the whole site indexed by SEOMoz software? Thanks for your answers!
Moz Pro | | ssiebn70 -
How do I change domain settings for a campaign?
So I set it up one of my Moz campaigns as domain.com Rogerbot only hits 1 page. I am thinking I should change it to www.domain.com, but I cannot seem to find how to do this. Thoughts?
Moz Pro | | stubby0 -
Discrepancies in PA and LRDs reported in different SEOmoz tools
I've noticed a difference in the reported PA and LRD numbers for URLs depending on whether you use Open Site Explorer, or look at the same metrics from within the rankings history (in your campaign set up). I've checked this for a few URLs and what I'm seeing is the reported scores for PA and LRDs is different 9 times out of ten. The PA is sometiomes higher on one report, lower on another, or vice versa. Same for LRDs. I thought it might be because one report was lagging behind and using old data, but that would only make sense if I was seeing an increase in reported LRDs, but it just as often shows a decrease ! Is this just a bug in the campaign>rankings history report or is there a reason for the discrepancies?
Moz Pro | | Websensejim0