Overly-Dynamic Urls how to fix in SEOMOZ?
-
Hello.
I have about 300 warnings of overly-dynamic urls.
In urls like this:
http://www.theprinterdepo.com/clearance?dir=asc&order=price&p=10
As you can see all parameters are needed, and my ecommerce solution generates them automatically.
How can I get rid of these warnings? I suppose that by using robots.txt, but I have no idea about it.
In my google webmaster tools I have already configured that these parameteres the crawler should not index them.
Check the image here:
-
Hi Kami,
You might want to ask this in a new post. New posts on old threads don't bump a post in the Q&A forums, so not too many people will see this post (I only knew about it as I was notified from having subscribed last year).
-
Hi, We sort of have the same issue, We have over 5000 pages with the same issues actually. Our ecommerce site uses several different filter (Using Ajax) and we have many different urls like,
http://www.dellamoda.com/Designer-Pumps.html?sort=price&sort_direction=1&use_selected_filter=Y
http://www.dellamoda.com/Designer-Accessories.html?sort=title&use_selected_filter=Y&view=all
http://www.dellamoda.com/Designer-Accessories.html?sort=title&sort_direction=1&use_selected_filter=Y
Could we use the robots.txt file to disallow these as well? and do we need to put the whole url in there?
like:
Disallow: /*?sort=price&sort_direction=1&use_selected_filter=Y
if not how far into the url should be disallowed?
Any help would be greatly appreciated.
Thank you, Tony
-
John, having a ton of URLs indexed for the same page will actually dilute things, not help your rankings. Dr. Pete wrote a great post at http://www.seomoz.org/blog/duplicate-content-in-a-post-panda-world explaining duplicate content that should help give you a better understanding of things.
-
Hello there,
I have encounter a similar problem in a similar scenario. If we do not allow this pages to be crawled, wouldn't it reduce the number of pages indexed resulting in lower Google ranking?
-
Hi! Did Rasmus answer your question, or are you looking for some more help?
-
Disallow: /*?dir=desc
Disallow: /*&order=
I think yout should try with these lines, and test in Google Webmaster tools. This should leave only this page
https://www.theprinterdepo.com/clearance
That is what you want right?
-
Can I know the syntax for robots.txt to ignore those?
-
Sure thing!
For example:
<a <span="">href</a><a <span="">="</a>https://www.theprinterdepo.com/clearance?dir=desc&order=price" title="Set Descending Direction">src="https://www.theprinterdepo.com/skin/frontend/default/MAG060062/images/i_asc_arrow.gif" alt="Set Descending Direction" class="v-middle" />
This code is the code for reversing the result. So you can check to see if the page has a url query with "dir=asc" (the standard). If so the code above should instead be:
<a rel="nofollow" <span="">href</a><a rel="nofollow" <span="">="</a>https://www.theprinterdepo.com/clearance?dir=desc&order=price" title="Set Descending Direction">src="https://www.theprinterdepo.com/skin/frontend/default/MAG060062/images/i_asc_arrow.gif" alt="Set Descending Direction" class="v-middle" />However, I believe the best approach will be to change the meta tag for robots for the page.
if the url query is dir=asc, order=price then robots="index, follow". If dir is not asc, and order is not price then robots="noindex, follow".
-
I am a really newbie to SEO, can you please explain me how to do it?
-
Can you either set rel="nofollow" on the links on the page that changes the sorting, such that moz and google do not check these pages? Or you can set the robots="noindex, follow" on pages which are not the "standard" sort?
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Canonical sitemap URL different to website URL architecture
Hi, This may or may not be be an issue, but would like some SEO advice from someone who has a deeper understanding. I'm currently working on a clients site that has a bespoke CMS built by another development agency. The website currently has a sitemap with one link - EG: www.example.com/category/page. This is obviously the page that is indexed in search engines. However the website structure uses www.example.com/page, this isn't indexed in search engines as the links are canonical. The client is also using the second URL structure in all it's off and online advertising, internal links and it's also been picked up by referral sites. I suspect this is not good practice... however I'd like to understand whether there are any negative SEO effectives from this structure? Does Google look at both pages with regard to visits, pageviews, bounce rate, etc. and combine the data OR just use the indexed version? www.example.com/category/page - 63.5% of total pageviews
Technical SEO | | MikeSutcliffe
www.example.com/page - 34.31% of total pageviews Thanks
Mike0 -
How to handle temporary campaign URLs
Hi, We have just run a yearly returning commercial campaign for which we have created optimized URL's. (e.g. www.domain.tld/campaign including the category and brand names after the campaign www.domain.tld./campaign/womens This has resulted in 4500+ URL's being indexed in Google including the campaign name, now the campaign is over and these URL's do not exist anymore. How should we handle those URL's? 1.) 301 them to the correct category without the campaign name 2.) Create a static page www.domain.tld/campaign to which we 301 all URL's that have the campaign name in them Do you have any other suggestions on what the best approach would be? This is a yearly commercial campaign so in a year time we will have the same URL's again. Thanks, Chris
Technical SEO | | eCommerceSEO0 -
GWT, URL Parameters, and Magento
I'm getting into the URL parameters in Google Webmaster Tools and I was just wondering if anyone that uses Magento has used this functionality to make sure filter pages aren't being indexed. Basically, I know what the different parameters (manufacturer, price, etc.) are doing to the content - narrowing. I was just wondering what you choose after you tell Google what the parameter's function is. For narrowing, it gives the following options: Which URLs with this parameter should Googlebot crawl? <label for="cup-crawl-LET_GOOGLEBOT_DECIDE">Let Googlebot decide</label> (Default) <label for="cup-crawl-EVERY_URL">Every URL</label> (the page content changes for each value) <label style="color: #5e5e5e;" for="cup-crawl-ONLY_URLS_WITH_VALUE">Only URLs with value</label> ▼(may hide content from Googlebot) <label for="cup-crawl-NO_URLS">No URLs</label> I'm not sure which one I want. Something tells me probably "No URLs", as this content isn't something a user will see unless they filter the results (and, therefore, should not come through on a search to this page). However, the page content does change for each value.I want to make sure I don't exclude the wrong thing and end up with a bunch of pages disappearing from Google.Any help with this is greatly appreciated!
Technical SEO | | Marketing.SCG0 -
Www or not www base url
Here is the situation. Developer custom coded a magento commerce shop for a seo client and is having problems adding www to the URL without breaking the site. They wont be able to get this completed until a couple months down the road. We are starting monthly SEO this June. Most directories and websites link to the www version of a site not the non www. What should I expect since we are ranking for the non-www and linking to the www version. In web master tools i'm telling google to display the URL as www.
Technical SEO | | waqid0 -
URL paths and keywords
I'm recommending some on-page optimization for a home builder building in several new home communities. The site has been through some changes in the past few months and we're almost starting over. The current URL structure is http://homebuilder.com/oakwood/features where homebuilder = builder name Oakwood Estates= name of community features = one of several sub-paths including site plan, elevations, floor plans, etc. The most attainable keyword phrases include the word 'home' and 'townname' I want to change the URL path to: http://homebuilder.com/oakwood-estates-townname-homes/features Is there any problem with doing this? It just seems to make a lot of sense. Any input would be appreciated.
Technical SEO | | mikescotty0 -
URL Rewrite
We are trying to convince a client to do a massive rewrite from all URL's looking like this: "www.company.com/category/categoryId=82374" to something like "www.company.com/womens/jackets/rain" How would you describe the importance and impact of doing URL rewrites to an ecommerce site? What evidence/research can we share with them to convince them it is worth the time and effort to do?
Technical SEO | | Hakkasan0 -
Breadcrumb navigation with URL ending
Will it make a difference if a page has this format for URLs and breadcrumb navigation www.domain.com/category.html
Technical SEO | | Motava
www.domain.com/category/product1.html vs. www.domain.com/category/
www.domain.com/category/product1.html
or
www.domain.com/category/product1 does it make sense to change the category page or will it not make a huge difference?0 -
Slashes In Url's
If your cms has created two urls for the same piece of content that look like the following, www.domianname.com/stores and www.domianname.com/stores/, will this be seen as duplicate content by google? Your tools seem to pick it up as errors. Does one of the urls need 301 to the other to clear this up, or is it not a major problem? Thanks.
Technical SEO | | gregster10000