User-agent: 008
Disallow: /
(Tells 80legs Robot to stay out of the website)
User-agent:*
Disallow:
```
(Tells all other robots to visit all files of the website)
2) audible.com
```
User-agent: sitebot
disallow: /
```
(Tells Sitebot Robot to stay out of the website)
```
User-agent: *
Disallow: /mycart
Disallow: /ajaxcart
Disallow: /create-account
Disallow: /acc-merge
Disallow: /acc-merge6for6
etc..
```
(Tells all other robots not to enter specific directories listed)
Learn more here [http://www.robotstxt.org/robotstxt.html](http://www.robotstxt.org/robotstxt.html)