Good to use disallow or noindex for these?
-
Hello everyone,
I am reaching out to seek your expert advice on a few technical SEO aspects related to my website. I highly value your expertise in this field and would greatly appreciate your insights.
Below are the specific areas I would like to discuss:a. Double and Triple filter pages:
I have identified certain URLs on my website that have a canonical tag pointing to the main /quick-ship page. These URLs are as follows:
https://www.interiorsecrets.com.au/collections/lounge-chairs/quick-ship+black
https://www.interiorsecrets.com.au/collections/lounge-chairs/quick-ship+black+fabricConsidering the need to optimize my crawl budget, I would like to seek your advice on whether it would be advisable to disallow or noindex these pages. My understanding is that by disallowing or noindexing these URLs, search engines can avoid wasting resources on crawling and indexing duplicate or filtered content. I would greatly appreciate your guidance on this matter.
b. Page URLs with parameters:
I have noticed that some of my page URLs include parameters such as ?variant and ?limit. Although these URLs already have canonical tags in place, I would like to understand whether it is still recommended to disallow or noindex them to further conserve crawl budget. My understanding is that by doing so, search engines can prevent the unnecessary expenditure of resources on indexing redundant variations of the same content. I would be grateful for your expert opinion on this matter.
Additionally, I would be delighted if you could provide any suggestions regarding internal linking strategies tailored to my website's structure and content. Any insights or recommendations you can offer would be highly valuable to me.
Thank you in advance for your time and expertise in addressing these concerns. I genuinely appreciate your assistance. If you require any further information or clarification, please let me know. I look forward to hearing from you.
Cheers!
-
@williamhuynh You're correct to pay attention to parameters in your URLs, as they can have an impact on how search engines crawl and index your site. It's crucial, however, to handle them strategically.
Using canonical tags on these pages is already a good move. It signals to search engines which version of the page should be treated as the main one. Canonicalization helps avoid potential duplicate content issues and makes your website easier to understand from a search engine's perspective.
However, I'd be careful to disallow these pages or use a "noindex" tag. Disallowing these URLs in your robots.txt file might seem like a good way to save the crawl budget, but it can have unintended side effects. When you disallow a URL, it means that search engines can't access it at all, which could impact the crawling and indexing of your main (canonical) pages. This is especially true if these parameterized URLs have unique backlinks or user engagement signals that could be beneficial for your canonical URLs.
As for the "noindex" approach, this tells search engines not to include the page in their index. However, if these pages have valuable backlinks or user engagement signals, you might be missing out on some SEO value by not indexing them.
In my opinion, if your website is large and you're genuinely concerned about the crawl budget, a more suitable approach might be to use Google Search Console's URL Parameters tool. This tool lets you inform Google how to handle specific URL parameters.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Best redirect destination for 18k highly-linked pages
Technical SEO question regarding redirects; I appreciate any insights on best way to handle. Situation: We're decommissioning several major content sections on a website, comprising ~18k webpages. This is a well established site (10+ years) and many of the pages within these sections have high-quality inbound links from .orgs and .edus. Challenge: We're trying to determine the best place to redirect these 18k pages. For user experience, we believe best option is the homepage, which has a statement about the changes to the site and links to the most important remaining sections of the site. It's also the most important page on site, so the bolster of 301 redirected links doesn't seem bad. However, someone on our team is concerned that that many new redirected pages and links going to our homepage will trigger a negative SEO flag for the homepage, and recommends instead that they all go to our custom 404 page (which also includes links to important remaining sections). What's the right approach here to preserve remaining SEO value of these soon-to-be-redirected pages without triggering Google penalties?
Technical SEO | | davidvogel0 -
Unsolved What would the exact text be for robots.txt to stop Moz crawling a subdomain?
I need Moz to stop crawling a subdomain of my site, and am just checking what the exact text should be in the file to do this. I assume it would be: User-agent: Moz
Getting Started | | Simon-Plan
Disallow: / But just checking so I can tell the agency who will apply it, to avoid paying for their time with the incorrect text! Many thanks.0 -
How to boost the number of visitors to a specific page
Hello, Payday loan consolidation, debt settlement, credit card settlement, and debt consolidation are just a few of the pages I have. While walking through the search console dashboard, I noticed that while the position is improving, but impressions and traffic are decreasing, indicating a significant disparity. Please advise on how to resolve the issue.
Link Building | | OVLG0 -
Does anyone use paid seo tools
Hi, i see a lot of people claiming that paid seo tools work, i would like to know if anyone uses them. I have a new site that i am building and i am wondering if there are any good paid tools out there that could help me gain exposure quicker. I get a lot of emails from well known companies promoting their paid tools but have never bought any as i believe you should hear from people who have tried them first. If you feel there are any good paid seo tools out there for help with rankings and link building then i would love to hear about them
Technical SEO | | ClaireH-1848860 -
Should I noindex, follow categories?
Hey Everyone, A simple question (hopefully). Should I check or uncheck the noindex, follow setting for categories on our site? We've got about 5-6 but they aren't anything that people should know or would help in SEO. For example, one category is "featured content" and another is "what's happening." Checking them dictate where a post goes on the site. I'm pretty sure it should be checked, but I wanted to check with the experts first 🙂 http://d.pr/i/jtrc
Technical SEO | | ttb0 -
I can buy a domain from a competitor. Whats the best way to make good use of these links for my existing website
I can buy a domain from a competitor. Whats the best way to make good use of these links for my existing website
Technical SEO | | Archers0 -
Using an exsisting domain for a new busines?
I have a domain name that is in use and has a domain age of 4 years. My question is this, will taking that domain name and promoting it under a completely new business in a completely different industry with a totally different business model hurt getting this new business to rank? The domain name is my first and last name. I've been promoting videos that I like under this domain name. I would now like to use the domain name to promote my local SEO services. Will this hurt my efforts to rank with search engines since Google and others have been indexing the site for a certain industry and topic? Thanks
Technical SEO | | fun52dig
Gary0 -
Is there a good tool for finding the outbound links on a domain?
Hi, I am trying to find the number and preferably a list of outbound links on a site that has thousands of pages. Is there a good tool that you can recommend? Unless I missed it, I haven't seen this feature in SEOMoz. Thanks!
Technical SEO | | SparkplugDigital0