Question about robots.txt
-
Solved!
-
Just a friendly reminder. Please don't delete your question after it's been answered. It's very likely that someone in the future could have the same question and they would have been able to find the answer if you hadn't deleted the question.
-
Consider deleting all of this:
Disallow: /&limit
Disallow: /?limit
Disallow: /&sort
Disallow: /?sort
Disallow: /?route=checkout/
Disallow: /?route=account/
Disallow: /?route=product/search
Disallow: /?route=affiliate/
Disallow: /?marca
Disallow: /&manufacturer
Disallow: /?manufacturer
Disallow: /?filter
Disallow: /&filter
Disallow: /?order
Disallow: /&order
Disallow: /?price
Disallow: /&price
Disallow: /?filter_tag
Disallow: /&filter_tag
Disallow: /?mode
Disallow: /&mode
Disallow: /?cat
Disallow: /&cat
Disallow: /?product_id
Disallow: /&product_id
Disallow: /?route=affiliate/
Disallow: /*?keywordThose rules are telling Google not to crawl domain.com/EVERYTHING(then the URL parameter). This could be where the issue stems from. If you're worried about URLs with these things ranking, consider implementing canonical tags instead to point to the proper pages
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
SEO question
why does a business rank differ on google search and google maps (for example, a hair salon we do seo for ranks 5th for "hair salon in Dublin" on Google Maps and ranks 10th on Google search)
On-Page Optimization | | ryan.mamma0 -
Schema Question
I had ratings stars appearing on my site and recently started using the sale event schema, but the two won't show up at the same time, so the rating stars have now disappeared and have been replaced by sale event data. When looking around for more info I found the attached example which shows both appearing at the same time - however upon trying to replicate this myself with that same site I can't get both to appear. Does anyone know if it's possible for both schema data properties to appear in the results at the same time? save.png
On-Page Optimization | | meqdiw46ao0 -
Question about multiple versions of home page
Hi guys, I'm having a question, answer to which i'm unable to find anywhere. I browesed the whole internet lol. So the question is about multipple versions of the home page. In particular, i want to know how should i deal with home page URLs with this extention: /index.html All the rest possible versions of home page i know how to deal with but this one "/index.html" i don't. I did add a cononical tag to it but i'm wondering whether or not i should add 301 redirect to chosen version og the home page (let's say it is www.mydomain.com). Please advise the best practices on how to deal with this. Thanks in advance!
On-Page Optimization | | odmsoft0 -
URL question
When we type in the URL of www.JustBunkBeds.com on firefox we end up with (S) in URL https://www.justbunkbeds.com/ When we type in the URL of www.JustBunkBeds.com on Explorer we end up with http://www.justbunkbeds.com/ Appreciate answer to this question Tony
On-Page Optimization | | OCFurniture0 -
2 Question about URL structure
Hello guys 1 - I have a question about the best structure for URLs from the point of view of SEO: Is it OK to use the URL as mywebsite.com.br/long-tail-article Or is better this mywebsite.com.br/category/long-tail-article 2 - When part of my keyword is already in my "category", for example: mywebsite.com.br/digital-marketing/digital-marketing-is-good I leave it as it is, or in the following way: mywebsite.com.br/digital-marketing-is-good NOTE: Do not take into account that this URL would be different from other URLs in this category
On-Page Optimization | | seomasterbrasil0 -
Re="tag" Question
Hello, I own the site I putted rel="tag" in categories and product links , its correct? There are a lot of categories and products , I wont get penalized right? Just making sure to know if Im doing it right , thank you for help me 🙂
On-Page Optimization | | matiw0 -
Question Regarding RSS Feeds
A site I have been asked to take a look at has an RSS feed on there home page. The site offers Austrian mortgages. But the RSS feed is in the side bar and it is drawing information for Austrian News. I personally would of said that if it was to draw anything then it should be more accurately related to the site, or am I wrong? I also have seen that he has installed RSS Bomber, now it just submits his blog posts to a lot of RSS aggregators each time he makes a post. Is this a bad thing as I am not sure. I am thinking it cant be good as it is effectively automated but I would like others opinions on this. Thanks Paul
On-Page Optimization | | propertyhunter0 -
Photogallery and Robots.txt
Hey everyone SEOMOZ is telling us that there are to many onpage links on the following page: http://www.surfcampinportugal.com/photos-of-the-camp/ Should we stop it from being indexed via Robots.txt? best regards and thanks in advance... Simon
On-Page Optimization | | Rapturecamps0