Adding non-important folders to disallow in robots.txt file
-
Hi all,
If we have many non-important folders like /category/ in blog.....these will multiply the links. These are strictly for users who access very rarely but not for bots. Can we add such to disallow list in robots to stop link juice passing from them, so internal linking will me minimised to an extent. Can we add any such paths or pages in disallow list? Is this going to work pure technical or any penalty?
Thanks,
Satish
-
But as per the current SEO buzz, internal nofollow leads of waste of link juice and we cannot preserve it. Moreover some suggests not to use nofollow internally.
-
This is a great resource for all things robots.txt related: [http://www.robotstxt.org/robotstxt.html](http://www.robotstxt.org/robotstxt.html)
-
Hi,
Yes you can block in robots.txt. You can also use rel="nofollow" if you don't want to pass link juice.
[No Link Juice](https://www.example.com) Hope this helps. Thanks
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
What happens when non-relevant topic is getting more visitors?
Hi all, So we have a sub-domain which has user generated content like forums. Mostly the content is all about our product. Few times some spammy threads get posted and we delete them regularly. I have noticed that a non-relevant thread has been posted which about a movie. But this page got hundreds of clicks. I just wonder will this hurts being off topic and movie torrent thread or helps being receiving hundreds of visitors? Thanks
Algorithm Updates | | vtmoz0 -
Did .org vs. .com SEO importance recently changed?
I have seen previous answers in the Forum about this subject but Google has seemed to have again changed the playing surface. Within the past 30 days, we have seen a huge spike in organic search returns seeming to favor .org as domain authorities. Has anyone else noticed this shift and is it just coincidence or worth factoring in? If it is a shift, will Google punish those that have .org but have used.com previously for switching the redirects to serve .org first? Thanks, Jim
Algorithm Updates | | jimmyzig0 -
Ranking under a non-geobased, one word phrase
We have a local client who would like to score under the words "locksmith" and "locksmiths". What is the best way to get him to rank organically and not just in Google Plus Local for those keywords?
Algorithm Updates | | GregWalt0 -
What is the importance of listing score at Getlisted.org regarding higher local 7 pack rankings ?
What is the importance of listing score at Getlisted.org regarding higher local 7 pack rankings ? My listing score is 60% and i am trying to improve it. I am on 2nd page on local map results. So maximum score will help to get place in 7 pack ?
Algorithm Updates | | mnkpso0 -
Google automatically adding company name to serp titles
Maybe I've been living under a rock, but I was surprised to see that Google had algorithmically modified my page titles in the search results by adding the company name to the end of the (short) title. <title>About Us</title> became About Us - Company Name Interestingly, this wasn't consistent - sometimes it was "company name Limited" and sometimes just "company name. Anyone else notice this or is this a recent change?
Algorithm Updates | | DougRoberts0 -
Traffic dropping after blog was added...
We have a major client that gets over a thousand organic visits per day. They also self manage an adwords campaign that generates a few thousand clicks a day. Lat summer they got a new website with a blog. The blog has a couple of teaser paragraphs on the home page with the new blog posts, in addition to lots of static text about the items sold on the site. What has happened is, our organic traffic has changed form the main keywords of what the site sells, to things talked about in the blog. Traffic hasn’t dropped dramatically, but we have lost all our big keywords, for example, a keyword that was generating 40 organic clicks per day a year ago we receive no traffic for now, and much more obscure keyword combinations from the blog are being picked up. Is it the addition of the blog that is causing this problem, or the blog teasers that are on the home page of the site? We like the traffic from the blog terms, but we would like our former main keyword traffic back as well, how can we accomplish this, and what do you think has occurred here? Thanks for your help.
Algorithm Updates | | WhiteHat120 -
Is it hurting my seo ranking if robots.txt is forbidden?
robots.txt is forbidden - I have read up on what the robots.txt file does and how to configure it but what about if it is not able to be accessed at all?
Algorithm Updates | | Assembla0