URL Parameters
-
Hi there, I have a magento sort by feature which has indexed loads of pages in Google with urls that have /shopby/ in them.Over 8k pages have been indexed like this. I cannot edit the robots within the page but have now disallowed the urls in robots.txt - i guess this will prevent new ones being indexed but not deindex current ones?
So I looked into URL parameters, I added 'shopby' as a parameter in webmaster tools and told Google not to crawl any urls with this in it, will this deindex the pages already indexed?
The only other way seems to be manually removing 8k urls, which i do not want to do.
Any advice much appreciated. Obviously I do not want these urls indexed as they are weak/duplicate sort by search pages, I fear the panda update would not be too kind on it long term?
-
That would be correct. What you have are "self referencing" canonical tags. That does the exact opposite of what you need it to do. It tells Google all of those pages are valid, where you need it to tell Google all of those pages are just copies of only ONE valid page.
-
Yes.
The idea of having a canonical is to point it to another page, many just don't get this
-
Hi guys. Well the site has been setup so every page has a unique canonical tag, the canonical tag being the url it is on.
I guess I need to find a way in magento to make all /shopby/ urls have the same canonical tag then it will deindex once Google recrawl?
-
Assuming you have your canonicals done correctly, the pages will disappear in time.
the pages you wont to de-index, should have a canonical tag that points to the original.
-
Hi there, the canonical tags are there but the pages are still indexed.
No links point to these pages, they are just sort by urls being generated off a widget.
-
I would not de index the page either with robots or WMT.
links in your site that point to any of these pages will now pour their link juice into un indexed pages.
use a canonical tag to fix the problem.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Canonical Tags & GWT Parameters
A site I'm working on has canonical tags which I find to be accurate, regardless of tracking parameters or anything else added to the url. The tag looks like: And we have alot of parameters in Google Search Console that look like Parameter Crawl page Let Googlebot Decide destination Let Googlebot Decide filters Let Googlebot Decide Since all of our parameters follow a question mark, like http://www.examplesite.com/questions/avocados?source=ad12345 and all of our pages have canonical tags showing the representative url without the additional parameters, why wouldn't we just have the one parameter in GWT as Parameter Crawl ? Representative URL I ask because I find that Google analytics shows pages with parameters as landing pages in search, which has me concerned about Google seeing it as duplicate content. Thanks! Best... Darcy
Reporting & Analytics | | 945010 -
URLS are top keywords in GA?
Hey Moz, For some reason on my father's website, michaelpadway.com, the top 2 keywords from organic are complete urls from his site. This doesn't makeugh sense to me. Any ideas?
Reporting & Analytics | | MarloSchneider1 -
Custom URL tracking for paid online ads
Hello! Our marketing team is testing paid online ad networks (banner ads, mobile ads and video ads) this year in addition to some traditional television advertising. We would like to track how effective these various ads are, and I'm wondering the best method to do so. In all cases, we're not setting up new pages for these ads to go to. They will simply go to an existing page on our site. For tracking purposes, here's what I'm wondering... If we set up custom URLs on our site (e.g. www.example.com/sports) then have the visitor immediately redirected to the intended page on our site (typically our home page), will Google Analytics show that custom URL in any report to see how much traffic flowed through it? Or will it not register because a page doesn't really exist for that URL? The biggest issue is with the banner ad network, which targets around ten categories of sites (sports, moms, entertainment, etc.). I know I'll be able to find the network listed as a referrer to see the total traffic the network sent us, but we would like to know specifically which category drove the visits. As such, would a custom URL for each category work, or will Google Analytics not pick it up because it's not hitting an actual page? For television ads, we are showing our URL as www.example.com/tv, which would then redirect to the intended landing page. In this case, it's a little more challenging because I won't have the referrer traffic to go by. But same problem... will GA recognize that URL and show it in Behavior > Site Content > All Pages? I hope this makes sense. If not please let me know and I'll try to explain. Thanks in advance,
Reporting & Analytics | | SmileMoreSEO
Erik0 -
Landing page URL appearing as keyword
Hi Mozers, I've recently experienced the URLs of my key landing pages coming up as keywords. This has been on the rise since early July (when it was relatively insignificant) to the current position (see image below) where they make up the majority of my top keywords. Drilling down into a bit more detail, this seems to be almost exclusively Desktop traffic but in terms of Technology there are no clear standouts (seems to be mostly Windows OS and Chrome). Has anyone else been experiencing this?
Reporting & Analytics | | mopland0 -
Why are there url's in my np Keywords in google analtyics?
I have been scratching my head at this one. On my not provided keywords, there is a url. Keyword is the primary dimension. It doesn't makes sense why there would be url keywords for pages with a different url. For example, the keywords for page www.xyz.com/abc np - /someotherurl.com Thanks for your insights in advance!
Reporting & Analytics | | konverge0 -
Google Analytics Organic Search Keywords Suddenly Displaying FulL Urls
In my Google Analytics, the top keywords for Organic Search are suddenyl displaying full URLs. For example, now the third and fourth keywords are http://www.domain.com/highly-specific-URL. These have all started recently around the same day, July 12th. I've checked back, and we've made no internal changes to the site around that time that could affect this. Any thoughts on this? Thanks! P.S. It might be related to rich snippets, but I cannot tell at this point.
Reporting & Analytics | | 10SL0 -
Why do I have few different index URL addresses?
Yes I know, sorry guys but I also have a problem with duplicate pages. It shows that almost every page of my site has a duplicate content issue and looking at my folders in the server, I don't see all these pages... This is a static Website with no shopping cart or anything fancy. The first on the list is my [index] page and this is giving me a hint about some sort of bad settings on my end with the SEOMOZ crawler??? Please advice and thank you! index-variations.jpg
Reporting & Analytics | | cssyes0 -
Has Anyone Else Noticed A Jump In Google Analytics Traffic Since Session Parameters Were Changed?
Ever since Google Analytics changed their session parameters August 12th I have seen a 20% jump in organic traffic & bounce rates along with a decline in pages/visit and conversion rate. To be clear, I don't put a whole heck of a lot of stock in these metrics as stand-alone indications of how my site is performing. I'm just trying to get to the bottom of this blip. I noticed some other people mentioned a similar phenomenon in other SEO forums and blog comments, but nobody seems to be talking about this here at SEOMoz (unless I just haven't looked in the right place). I'm not saying the change I noticed has anything to do with the session update, I'm just wondering if anyone else has experienced something similar so that I can either cross it off the list of possible causes or explore further.
Reporting & Analytics | | eTundra0