Adding non-important folders to disallow in robots.txt file
-
Hi all,
If we have many non-important folders like /category/ in blog.....these will multiply the links. These are strictly for users who access very rarely but not for bots. Can we add such to disallow list in robots to stop link juice passing from them, so internal linking will me minimised to an extent. Can we add any such paths or pages in disallow list? Is this going to work pure technical or any penalty?
Thanks,
Satish
-
But as per the current SEO buzz, internal nofollow leads of waste of link juice and we cannot preserve it. Moreover some suggests not to use nofollow internally.
-
This is a great resource for all things robots.txt related: [http://www.robotstxt.org/robotstxt.html](http://www.robotstxt.org/robotstxt.html)
-
Hi,
Yes you can block in robots.txt. You can also use rel="nofollow" if you don't want to pass link juice.
[No Link Juice](https://www.example.com) Hope this helps. Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Folders or no folders in url?
What's best for SEO: a folder or no folder? For example: https://domain.com/arizona-dentist/somecontent or just https://domain.com/somecontent. The website has 100+ pages with "dentist" within the content of the somecontent pages, as well as specific pages for /arizona-dentist/. Also, the breadcrumb for the somecontent page would appear something like follows: Arizona Dentist > Some Content ... you can find the somecontent page from the Arizona Dentist page. I didn't include folders in the path because I did not want the url to be too long. In terms of where it is showing up on google search results...it is within the top 3-4 on the first page when searching Arizona dentist come content. The website is pretty organized even without subfolders because it was made using Umbraco. I am wondering if using folders will increase the SEO ranking, or if it really doesn't and could hurt it if paths become too long; especially since it's not doing too bad in the search ranking right now. -Thanks in advance for any help.
Algorithm Updates | | bellezze0 -
How much do branded search organic traffic & direct traffic impact the ranking for their non-branded topic/keyword?
Hi Moz community, We can see many websites with a reputation will have more number of visitors landing with these two types of traffic mostly (>90%): organic traffic of brand queries and direct traffic. Will these visits help and impact the ranking of these websites for the keywords/topics they been employing? Ex: Moz will have many such visitors. Will this really impact the ranking of Moz for non-brand queries they try to rank for, like "SEO Software". If so, will this have a huge impact or it's just a minor ranking factor. Because we have this with our website and we don't see such boost in rankings compared to our competitors with less direct traffic; where as I been looking at some SEO articles that direct traffic is one of the most important ranking factors. Thanks
Algorithm Updates | | vtmoz0 -
Fresh content..how important to SERP position?
I've heard that fresh content helps boost your position in the serps. If i wrote all new unique content on some of my pages that havent been changed in several years, would i see a boost in the rank? If so, how many positions?
Algorithm Updates | | Ron100 -
W3C Validation: How Important is This to Ranking
Hi, I'm currently working with a developer who is trying to tell me that validation errors and warnings are of little to no importance in a website's SERP. In the past, whenever I've had a site that was experiencing problems ranking for a keyword terms, this was one of the first places we'd look. Is this still a relatively important component in getting a site to rank?
Algorithm Updates | | maxcarnage2 -
PR Directory Vs Non PR Directory
Hello Guys, i thought to do some directory submission for my website, i am little confused. I have list of page rank directory and non pr directory. Can anyone suggest me which one shall i prefer most. **Getting approved by pr directory takes long time, so shall i prefer non pr directory to get my listing approved fast. ** please suggest me which one i have to prefer, if anyone have fast pr approval directory list please share. Thanks In Advance
Algorithm Updates | | sumit600 -
Should I block non-informative pages from Google's index?
Our site has about 1000 pages indexed, and the vast majority of them are not useful, and/or contain little content. Some of these are: -Galleries
Algorithm Updates | | UnderRugSwept
-Pages of images with no text except for navigation
-Popup windows that contain further information about something but contain no navigation, and sometimes only a couple sentences My question is whether or not I should put a noindex in the meta tags. I think it would be good because the ratio of quality to low quality pages right now is not good at all. I am apprehensive because if I'm blocking more than half my site from Google, won't Google see that as a suspicious or bad practice?1 -
Major Slipping of highly important keywords in a few days
Realized some major slipping on some of my most important keywords- mn realtors and minnesota homes for sale- my site is joeandcindy.com After months of working on traffic, blogs etc, wondering what could slap me 10-25 spots in just a few days. There were no errors showing up on the report that I can see. Just looking for some quick advice on what I might be missing and some quick action steps I might take to reverse the trend. Thanks!
Algorithm Updates | | jjwelu0 -
Importance of Product Review Syndication?
Greetings everyone I have been tasked to do research on just how important it is to have product reviews syndicated with Google's (star rating found in Google Shopping). I am unable to find any research reports or studies on this nor any quantitative data on it's impact, beneficial or otherwise. If any of you folks have any first hand experiences, perhaps some before and after figures, that would be great. Thanks
Algorithm Updates | | airnwater0