Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Robots.txt not working?

2

4

965

Log in to reply

levalencia1 last edited by
Hello

This is my robots.txt file

http://www.theprinterdepo.com/Robots.txt

However I have 8000 warnings on my dashboard like this:4

What am I missing on the file¿

Crawl Diagnostics Report

On-Page Properties

<dl>

<dt>Title</dt>

<dd>Not present/empty</dd>

<dt>Meta Description</dt>

<dd>Not present/empty</dd>

<dt>Meta Robots</dt>

<dd>Not present/empty</dd>

<dt>Meta Refresh</dt>

<dd>Not present/empty</dd>

</dl>

URL: http://www.theprinterdepo.com/catalog/product_compare/add/product/100/uenc/aHR0cDovL3d3dy50aGVwcmludGVyZGVwby5jb20vaHAtbWFpbnRlbmFjZS1raXQtZm9yLTQtbGo0LWxqNS1mb3ItZXhjaGFuZ2UtcmVmdWJpc2hlZA,,/

0 Errors
- No errors found!
1 Warning
- 302 (Temporary Redirect)
  
  Found about 5 hours ago
  
  <a class="more">Read More</a>
1 Reply Last reply
Reply Quote 0
levalencia1 last edited by

anyone in here? what should I do to fix this?
1 Reply Last reply
Reply Quote 0
levalencia1 @SlavaRybalka last edited by

No I havent tried but I will.

I use magento commerce which is a great ecommerce application
1 Reply Last reply
Reply Quote 0
SlavaRybalka last edited by

1. Have you tried it without product_compare?

2. Bad CMS?
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

New Magento store, is better to place it in a new url or it can work fine in a subdomain?

Hi friends, We are working on a new Magento store for one of our websites. Our strategy is for organic positioning of the products, so we need to understand if the Magento products will position better if the system is hosted in a subdomain of the main company domain or if it is better to host it under its own domain. Thanks,
Technical SEO | | FWC_SEO

0
Regional sites built on different platforms - will this solution for international targeting work?

We are working with our dev team on a few upcoming user stories to improve store.hp.com. We came across a question which isn’t clear in the international targeting documentation. Within http://store.hp.com, we have a number of regional stores, but those are often built on separate platforms. Therefore a story developed on the US infrastructure doesn’t carry over to Canada and so forth. The Canada Store is managed by a different team, so that story needs to get scoped, prioritized, etc. independently. In regards to helping Google understand page equivalence, will Google accept the page relationship if we include hreflang tags exclusively in the sitemap for the US site and exclusively as page-level markup for Canada site? For example: http://store.hp.com/CanadaStore (hreflang notation at page-level): http://store.hp.com/us/en" /> http://store.hp.com/CanadaStore" /> http://store.hp.com/us/en" /> http://store.hp.com/us/en (hreflang notation within sitemap file): <loc>http://store.hp.com/us/en</loc> rel="alternate" hreflang="en-ca" href=" http://store.hp.com/CanadaStore" /> rel="alternate" hreflang="en-us" href="http://store.hp.com/us/en" /> Appreciate the help anyone can give! Zach
Technical SEO | | ZachKline

0
Robots.txt Disallow: / in Search Console

Two days ago I found out through search console that my website's Robots.txt has changed to User-agent: *
Disallow: / When I check the robots.txt in the website it looks fine - I see its blocked just in search console( in the robots.txt tester). when I try to do fetch as google to the homepage I see its blocked. Any ideas why would robots.txt block my website? it was fine until the weekend. before that, in the last 3 months I saw I had blocked resources in the website and I brought back pages with fetch as google. Any ideas?
Technical SEO | | RAN_SEO

0
Robots.txt to disallow /index.php/ path

Hi SEOmoz, I have a problem with my Joomla site (yeah - me too!). I get a large amount of /index.php/ urls despite using a program to handle these issues. The URLs cause indexation errors with google (404). Now, I fixed this issue once before, but the problem persist. So I thought, instead of wasting more time, couldnt I just disallow all paths containing /index.php/ ?. I don't use that extension, but would it cause me any problems from an SEO perspective? How do I disallow all index.php's? Is it a simple: Disallow: /index.php/
Technical SEO | | Mikkehl

0
Removal request for entire catalog. Can be done without blocking in robots?

Bunch of thin content (catalog) pages modified with "follow, noindex" few weeks ago. Site completely re-crawled and related cache shows that these pages were not indexed again. So it's good I suppose 🙂 But all of them are still in main Google index and shows up from time to time in SERPs. Will they eventually disappear or we need to submit removal request?Problem is we really don't want to add this pages into robots.txt (they are passing link juice down below to product pages)Thanks!
Technical SEO | | LocalLocal

0
Robots.txt Showing in SERP Results

Currently doing a technical audit for a website and when I search "Site:website.com -www" the only result is website.com/robots.txt I was wondering if anyone else has come across this before -- or what this may mean from a technical audit standpoint. Thank you!
Technical SEO | | vectormedia

0
How to allow one directory in robots.txt

Hello, is there a way to allow a certain child directory in robots.txt but keep all others blocked? For instance, we've got external links pointing to /user/password/, but we're blocking everything under /user/. And there are too many /user/somethings/ to just block every one BUT /user/password/. I hope that makes sense... Thanks!
Technical SEO | | poolguy

0
Is my 301 redirect working?

Very simple question here . I've redirected a bunch of older pages with decent ranking to some newer pages on my site, using the Thesis theme's built-in redirect function. However, in the SERPS, the older pages (and, importantly, older titles) still show up. When clicked on, they redirect to the new page, but it's still irritating because the older titles make the site look out of date. Is this Working As Intended, or have I or my theme done something wrong? And if it's the latter, what's the best way to achieve a redirect, preferably with a Wordpress plugin?
Technical SEO | | Cairmen

0