Ruling out subfolders in pro tool crawl
-
Is there a way to "rule out" a subfolder in the pro dashboard site crawl? We're working on a site that has 500,000+ pages in the forums, but its the CMS pages we're optimizing and don't want to spend the 10k limit on forum pages.
-
Hey Aaron. That's a good question for the SEOmoz help desk. I don't think there's a way to do that yet, but you should definitely still ask them to help.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Tools for editorial organizations?
Other than google trends, are there tools a publication could give its writers to help them optimize their articles. Sometimes these articles are very newsy pieces, sometimes they are more evergreen features. In other words, if they're writing a story about the Greek Debt Crisis, I'd love to give them a tool that would suggest the language that is trending most at the moment and then, as the story evolves, identify the language that would be important then. Are there tools to help with this?
Moz Pro | | nymedia0 -
Crawl Report Re-direct Notice?
Just trying to understand if this is bad or not. The crawl report has picked up that my website is redirecting (301) from http://mysite.com to http://www.mysite.com - under Crawl Notices (blue section). Is this the wrong way to do it as we wanted the www domain version? Is that why SEOMoz has flagged it ?
Moz Pro | | Ubique0 -
On Page Ranking Tool Giving Weird Reports
My on page ranking tool is giving two entirely different reports for my website - I get one report for my domain name and a different report for the index.html even though essentially both of those pages are...well...the same. Not sure what's going on, hoping it's not an indication of a more serious issue? I appreciate any help!
Moz Pro | | Virage0 -
Is there a keyword suggestion tool available in the SEOMOZ suite of tools?
Is there a keyword suggestion tool available in the SEOMOZ suite of tools that is similar to semrush.com? semrush allows you to put in a URL and then will tell you what keywords you rank for. Looking for a good tool that is similar.
Moz Pro | | webestate0 -
Recent SEOMoz Crawl = Strange Results
Did anyone else get some really strange results in their weekly crawls this week with the campaign tool? Either my ranks sky rocked across three different sites or the tools is busted. Something to the tune of having 4 pages ranking in the top 30 to now having 15-16 pages ranking in the top 30. I'd love to find out it is just all the hard work paying off but i am worried it is the later. Regards - Kyle
Moz Pro | | kchandler0 -
Competitive Link Analysis Tool?
Hi, I ran a competitive link analysis report today and back came quite a few domains that 2 or more of my 5 main competitors link from. Is it worth me submitting links to these sites? And would i be best served submitting my homepage URL or submitting a brand page such as Creative Recreation Trainers? I want to target that brand but don't want to do it if my main URL is better? Any ideas? See below my report. | Subdomain | Subdomain mR | Subdomain mT | # Competitors | # Linking Pages | Link Acquired |
Moz Pro | | YNWA
| t.co/ | 8.05 | 8.04 | 2 | <a>2</a> | |
| ww2.cox.com/ | 5.99 | 6.50 | 2 | <a>3</a> | |
| www.littlewebdirectory.com/ | 5.90 | 5.59 | 2 | <a>2</a> | |
| www.amazines.com/ | 5.69 | 5.66 | 2 | <a>3</a> | |
| svpply.com/ | 5.66 | 5.53 | 3 | <a>20</a> | |
| www.jayde.com/ | 5.64 | 5.68 | 3 | <a>4</a> | |
| www.pearltrees.com/ | 5.58 | 5.81 | 2 | <a>2</a> | |
| www.businessseek.biz/ | 5.52 | 5.51 | 2 | <a>3</a> | |
| www.a1articles.com/ | 5.50 | 5.22 | 3 | <a>9</a> | |
| www.linksilo.de/ | 5.48 | 5.23 | 2 | <a>15</a> | |
| www.alistsites.com/ | 5.46 | 5.24 | 2 | <a>38</a> | |
| www.the-free-directory.co.uk/ | 5.37 | 5.07 | 2 | <a>20</a> | |
| www.walhello.com/ | 5.30 | 4.97 | 2 | <a>2</a> | |
| www.quarkbase.com/ | 5.14 | 5.12 | 2 | <a>2</a> | |
| snipsly.com/ | 5.13 | 5.20 | 2 | <a>21</a> | |
| www.counterdeal.com/ | 5.12 | 5.07 | 2 | <a>2</a> | |
| www.01webdirectory.com/ | 5.03 | 5.03 | 2 | <a>2</a> | |
| www.2addlink.info/ | 4.92 | 4.58 | 3 | <a>4</a> | |
| www.fuk.co.uk/ | 4.64 | 5.00 | 3 | <a>20</a> | |
| www.final-fantasy.us/ | 4.63 | 4.77 | 2 | <a>2</a> | |
| oyax.com/ | 4.42 | 4.61 | 2 | <a>4</a> | |
| www.touchretail.co.uk/ | 4.33 | 4.21 | 2 | <a>4</a> | |
| tptbtv.cold10.com/ | 4.27 | 4.86 | 3 | <a>1</a> | |
| www.mastbusiness.com/ | 4.23 | 4.34 | 2 | <a>2</a> | |
| www.competitionhunter.com/ | 4.16 | 4.21 | 2 | <a>6</a> | |0 -
RogerBot does not respect some rules??
Hello; Every week when I see my stats I notice that RogerBot has crawled 10000 form my website, even pages with a no index or not allowed in the robots.txt. Is it possible to avoid him from crawling the these pages? They are form pages in my site, with are not indexed by google, they have a noindex and they are not allowed for crawling in the robots.txt. Thanks everyone for your help!!!
Moz Pro | | jgomes0 -
Onpage Optimization Tool - Optimize it? :)
I've been using your on-page optimization tool allot lately, I must say it simply is a great checklist to run a page through and it forces you to think about it a bit more and you notice stuff that you might otherwise have overlooked (read forgot) . But! ('cause there's always a but..) I have noticed a few issues: it could be optimized to recognize plural endings, given this is a hard one since there's allot of languages.. but It would be awesome if it did.. right? (just like the SE's do) I would be more then willing to help with the Danish. Since you already specify what version of google you wanna target eg: ".DK" it might not be all that hard to implement plural? now that we are mentioning other languages.. It would be equally sweet if it would see the correlation between Ø and OE, Å and ÅÅ and so on.. (scandinavian chars for those of you who don't know) again the SE's do For German letters I expect (not sure though, I'm not German, I speak it a bit though, so if your German feel free to correct me 🙂 that the SE's would see the letter Ö as an OE.. Ü as UE, Ä as an AE and so on. Why is the above important? well because that many still use those versions of the letters in URL's. Even though all browsers/mail clients now a'days are able to understand punycode.
Moz Pro | | ReneReinholdt1