Handling '?' in URLs.
-
Adios! (or something),
I've noticed in my SEOMoz campaign that I am getting duplicate content warnings for URLs with extensions. For example:
/login.php?action=lostpassword
/login.php?action=register
etc.
What is the best way to deal with these type of URLs to avoid duplicate content penelties in search engines?
Thanks
-
Hi Craig,
If you are running Apache with PHP, then you could look into mod_rewrite and do some URL rewriting for your urls to look like /login/lostpassword instead of /login.php?action=lostpassword
Best regards,
Guillaume Voyer. -
Thanks, but whilst this will work for this example it won't work on pages that I do want indexed but on occasions have a '?' component applied. I want to tell a search engine to not index (and ignore) any '?' componant but still index the native URL.
-
Add 'noindex, nofollow' robots meta tag to the login page or use a robots.txt file.
More info here > http://www.robotstxt.org/meta.html
DD
-
And what is the best way to do that? That is the question I'm really asking...
-
First of all you are not going to get penalized by that!
You can make this pages nofollow in you robot.txt file. there is no reason for those pages to be indexed.
/login.php?action=lostpassword
/login.php?action=register
Good luck
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Google Search Console 'Change of Address' Just 301s on source domain?
Hi all. New here, so please be gentle. 🙂 I've developed a new site, where my client also wanted to rebrand from .co.nz to .nz On the source (co.nz) domain, I've setup a load of 301 redirects to the relevant new page on the new domain (the URL structure is changing as well).
Technical SEO | | WebGuyNZ
E.G. On the old domain: https://www.mysite.co.nz/myonlinestore/t-shirt.html
In the HTACCESS on the old/source domain, I've setup 301's (using RewriteRule).
So that when **https://www.mysite.co.nz/**myonlinestore/t-shirt.html is accessed, it does a 301 to;
https://mysite.nz/shop/clothes/t-shirt All these 301's are working fine. I've checked in dev tools and a 301 is being returned. My question is, is having the 301's just on the source domain only enough, in regards to starting a 'Change of Address' in Google's Search Console? Their wording indicates it's enough but I'm concerned, maybe I also need redirects on the target domain as well? I.E. Does the Search Console Change of Address process work this way?
It looks at the source domain URL (that's already in Google's index), sees the 301 then updates the index (and hopefully pass the link juice) to the new URL. Also, I've setup both source and target Search Console properties as Domain Properties. Does that mean I no longer need to specify that the source and target properties are HTTP or HTTPS? I couldn't see that option when I created the properties. Thanks!0 -
How do I customize Magento product urls?
I would like my product urls to be /category/manufacturer/name/part#. This would be the only url the item uses and how the product is accessed. It would also be used for product feeds. My first attempt was to use https://amasty.com/magento-unique-product-url.html This creates a single url but I can not customize it. Sometimes it selects the manufacturer and sometimes the category. My second attempt was with https://www.magentocommerce.com/magento-connect/custom-product-urls-seo.html I have it installed but it doesn't change the urls. Has anyone been able to do this successfully?
Technical SEO | | Tylerj0 -
Disallowing WP 'author' page archives
Hey Mozzers. I want to block my author archive pages, but not the primary page of each author. For example, I want to keep /author/jbentz/ but get rid of /author/jbentz/page/4/. Can I do that in robots by using a * where the author name would be populated. ' So, basically... my robots file would include something like this... Disallow: /author/*/page/ Will this work for my intended goal... or will this just disallow all of my author pages?
Technical SEO | | Netrepid0 -
My blog post for a specific keyword is in the 'omitted results'. Why might this be, and how to overcome it?
My website Homepage: http://kulraj.org Here is the page I am working to rank for:** http://kulraj.org/2014/07/15/hedonic-treadmill/** When I search specifically for 'kulraj hedonic treadmill' just to test it, the first result is this: kulraj.org_/tag/_hedonic-treadmill. It shows the shortened version of the article that is within the Tag page. [I'm new to SEO and Moz, please keep in mind] Moz has told me I have duplicate content, which is regarding my main Blog page and Tags page, which is true the content is duplicate. However, the actual blog post itself is not displayed anywhere else on the website, or anywhere else on the web. Moz confirms this, and reports no duplicate content warning. My questions, therefore, are: 1. How do I actually go about installing a rel canonical tag within a standard WordPress dashboard (I'm using Genesis Framework) - I'm finding great difficulty finding instructions on this anywhere on the web. I clearly need to fix the issue with Blog page and Tags Page. 2. Why would my blog post be omitted, and are there any suggestions I could implement to bring it into the main search results. Other things I've noticed: 1. If I type this URL in: kulraj.org/hedonic-treadmill, it automatically redirects to http://kulraj.org/2014/07/15/hedonic-treadmill/ 2. Inside Google Webmaster Tools it says: No new messages or recent critical issues. 3. Regarding the above, when I click 'Labs > author stats' within Webmaster Tools, it shows nil stats, so something there is not quite right either, even though Google+ Authorship is confirmed.
Technical SEO | | Kulraj0 -
Changed URL of all web pages to a new updated one - Keywords still pick the old URL
A month ago we updated our website and with that we created new URLs for each page. Under "On-Page", the keywords we put to check ranking on are still giving information on the old urls of our websites. Slowly, some new URLs are popping up. I'm wondering if there's a way I can manually make the keywords feedback information from the new urls.
Technical SEO | | Champions0 -
Updating content on URL or new URL
High Mozzers, We are an event organisation. Every year we produce like 350 events. All the events are on our website. A lot of these events are held every year. So i have an URL like www.domainname.nl/eventname So what would you do. This URL has some inbound links, some social mentions and so on. SO if the event will be held again in 2013. Would it be better to update the content on this URL or create a new one. I would keep this URL and update it because of the linkvalue and it is allready indexed and ranking for the desired keyword for that event. Cheers, Ruud
Technical SEO | | RuudHeijnen0 -
Best Practices for adding Dynamic URL's to XML Sitemap
Hi Guys, I'm working on an ecommerce website with all the product pages using dynamic URL's (we also have a few static pages but there is no issue with them). The products are updated on the site every couple of hours (because we sell out or the special offer expires) and as a result I keep seeing heaps of 404 errors in Google Webmaster tools and am trying to avoid this (if possible). I have already created an XML sitemap for the static pages and am now looking at incorporating the dynamic product pages but am not sure what is the best approach. The URL structure for the products are as follows: http://www.xyz.com/products/product1-is-really-cool
Technical SEO | | seekjobs
http://www.xyz.com/products/product2-is-even-cooler
http://www.xyz.com/products/product3-is-the-coolest Here are 2 approaches I was considering: 1. To just include the dynamic product URLS within the same sitemap as the static URLs using just the following http://www.xyz.com/products/ - This is so spiders have access to the folder the products are in and I don't have to create an automated sitemap for all product OR 2. Create a separate automated sitemap that updates when ever a product is updated and include the change frequency to be hourly - This is so spiders always have as close to be up to date sitemap when they crawl the sitemap I look forward to hearing your thoughts, opinions, suggestions and/or previous experiences with this. Thanks heaps, LW0 -
About Bot's IP
Hi, one of my customers had probably block the IP of SEOMOZ's bot. Could you give me : IP User-agent's name thks for helping me 😉
Technical SEO | | dawa1