I wish! The affiliate program is new. It's an unknown entity for me. 7 figures is just normal sales. The in-house software has the capacity to allow the blogger to choose a product and create custom code and a thumbnail for it to put in their site, like Amazon does, but they'll have to add the nofollow by hand or I will need to pay to have the software modified, which is what I'll probably end up doing. I have no desire to get a manual penalty for manipulating page rank and I'm surprised it's not a part of the software already.

If you're an Amazon affiliate it is.

By having millions of links to their website where people are being paid to do so, they're encouraging the manipulation of Google PageRank. I don't see why the rules should be any different for them because they're reputable. My site is reputable too. It's an online store with a 7 figure annual turnover, I'm just not 'Amazon'.

So I was just curious as to why they take the link juice from their affiliate links when the rest of us are encouraged to nofollow them. Everything I have read so far suggests that if you run an affiliate program, all the links where people link back to your store should be nofollow, and if you're running a blog that's got lots of affiliate links on it, you should protect your blog by adding nofollow links to all your advertising.

My in-house software doesn't nofollow by default, so I'm either going to have to get it re-written or give my affiliates manual instructions on how to alter their code. I chose not to use ClixGalore or anyone else like that so I don't have to pay their fees.

I am setting up an affiliate program using software built in to my shop already (x-cart). The links generated by the software do not have the rel="nofollow" in them. I'm assuming they should have?

When looking at Amazon, there must be millions of links out there pointing back to Amazon and all those links are followed back to them for link juice.

Am I missing something? Surely best practice here is to re="nofollow" so you're not seen to be manipulating Google PageRank?

I have an SEO pack installed on my shop that produces the ....product.html portion of the URL.

However, a layout feature on the site calls on javascript and adds some 'junk' on to the end of it. I am going to have the coding on the page removed, but I now have people linking to ....product.html?&cat=0&featured=Y instead of .....product.html

Likewise, I am about to set up an affiliate program and while I will be directing my affiliates to nofollow the links, I want to also set up an affiliate account for 'in-house' use and use them in blog posts to see whether my blog posts are converting in to sales. These URL's will also have a parameter at the end of them ie: ......product.html?partnerid=1234 (for example)

Will I get the internal keyword link juice from the URL's with the partner ID on the end?

I have a couple of quirks in my online shop that I'm ironing out. One of them is adding some URL parameters to product links.ie: website.com/product.html?&cat=0&featured=Y

If someone links to this URL, will I get the link juice as if it was website.com/product.html ?

I have URL parameters in Webmaster Tools and robots.txt set up to ignore them so they're not in the Google index, but I have found a few websites that have linked to us using these longer URL's and I'm wondering whether to write to them and ask them if they mind changing them or not.

When I manually fetch, the /images folder isn't on the list anymore.

For now I have just reuploaded the images in to a new folder and I'm creating my feed by hand, so that should get around it for now.

Thanks for your help.

I had created a manual Google Shopping Feed that was working fine, and then someone well meaning put a block in my robots.txt file so Google couldn't read the images folder. because of this, Google now won't accept my feed.

I changed the robots.txt file to allow them to read the images again, but it's been 3 days now and I'm still getting the error saying my products are disallowed because the robots.txt file won't let them scan for images.

Does anyone know how long it will take for Google to see it again?

Thanks so much for taking the time to respond.

I think I will add the https to WMT and remove them that way.

I will take a look through the .htaccess file and the creation of the ssl robots file. A while back, it seemed that Google was indexing a lot of my site as https and then the dropped it and went mainly back to http. I will get that sorted to make it clear.

I have found a way to get a list of 'some' of my 180,000+ garbage URLs now, and I'm going through the tedious task of using the URL removal tool to put them in one at a time. Between that and my robots.txt file and the URL Parameters, I'm hoping to see some change each week.

I have noticed when I put URL's starting with https:// in to the removal tool, it adds the http:// main URL at the front.

For example, I add to the removal tool:-

https://www.mydomain.com/blah.html?search_garbage_url_addition

On the confirmation page, the URL actually shows as:-

http://www.mydomain.com/https://www.mydomain.com/blah.html?search_garbage_url_addition

I don't want to accidentally remove my main URL or cause problems. Is this the right way this should look?

AND PART 2 OF MY QUESTION

If you see the search description in Google for a page you want removed that says the following in the SERP results, should I still go to the trouble of putting in the removal request?

www.domain.com/url.html?xsearch_...

A description for this result is not available because of this site's robots.txt – learn more.

Looks like I can only do the first thousand. It's a start though. Thank you for the information.

Many of the URL's on my list, when put in to Google search, are giving me 80-100  other variants I can remove by hand.

http://www.mathewporter.co.uk/list-a-domains-indexed-pages-in-google-docs/ for anyone else following.

Finally getting around  to doing this and noticed that when I change the start number to anything above 900, it doesn't work - ie: it's only letting me look at the first 1,000 results for some reason.

The list of 1,000 has given me some good URL's to search off for the filtering thingy that was generating all the garbage URL's but I'd love to get past 1,000 if I can.

Does anyone know how?

Much appreciated. Thank you.

Correct. I have gone in to URL Parameters already and set them to Crawl 'No URLs' for those we don't want crawled.

We haven't added those parameters listed in there in to the robots.txt file yet, but I will do that now. I had an initial consult today and we ran way over time when we discovered all this stuff so I have another appointment in a couple of weeks.

We have a sitemap of all the category pages and relevant static pages on the site already and Google has those indexed nicely. We just need to get rid of the 240,000 pages it has indexed that we don't want in there (frightening I know - it's a really high number).

I greatly appreciate you taking the time to respond. Thank you.

Thanks. There's a lot of auto-generated content, duplicate pages and we've set the robots.txt file up to exclude a large number of them. Now we wait.

Very helpful and greatly appreciated. Thank you.

HI Jane, further to the comment about M&S and Debenhams, I now understand what you mean by using a JS-powered navigation. While we can see it as users, the search engines can't see the endless links in the mega menu.

While having a phone consult with an SEO person today, he mentioned the same thing, using AJAX to hide that kind of information from Google so the users still get the experience of the content but Google isn't reading endless pieces of information it doesn't need.

I am a web developer, but not a high level programmer. Could you point me in the direction of where I should look as far as tutorials go so I can implement this in my site?

The links in the mega menu that I'll want to hide with AJAX are all readily available on main category pages and in breadcrumbs.

I'm doing a detailed analysis of how Google sees and indexes our website and we have found that there are 240,256 pages in the index which is way too many. It's an e-commerce site that needs some tidying up.

I'm working with an SEO specialist to set up URL parameters and put information in to the robots.txt file so the excess pages aren't indexed (we shouldn't have any more than around 3,00 - 4,000 pages) but we're struggling to find a way to get a list of these 240,256 pages as it would be helpful information in deciding what to put in the robots.txt file and which URL's we should ask Google to remove.

Is there a way to get a list of the URL's indexed? We can't find it in the Google Webmaster Tools.

Thanks again. I've just noticed our rankings climb for a few phrases & keywords purely by doing internal keyword linking and writing quality blog posts.  I'm sitting on the fence as to whether to ditch my mega menu or at least greatly simplify it. It provides ease of use for the end user to jump straight to the category they want, but if I'm losing traffic, then they're not on the site to use it.

Catch 22.

I've been watching a pile of Matt Cutts videos but haven't found one on this particular topic yet. I'm pretty sure my Panda issue was cough 20 million pages listed in URL Parameters from a poorly set up internal refine search feature that's been given the flick. We're down to 2.6 mil now and some of my rankings are slightly improving already.

Fabulous answer Jane. Thank you so much

I think the thing I'm concerned about now is how well my internal keyword linking is going to work with 300+ links on each page. We're going to the trouble of rewriting a lot of content and doing some very specific internal keyword linking to help people move around the shop better and also for SEO purposes.

I'm assuming these internal keyword links are a lot more effective if they're only competing against 100 links instead of 400+ ?

I got hit pretty badly by Panda 4.0 (1/3 of my traffic lost), and I'm fairly certain it was because Google had potentially indexed over 20 million pages from a site filtering piece of software and got done for duplicate content. I have since fixed that using URL Parameters and that 20 million is down to 2.7 million now and I have submitted a clean site map, so now I wait.

I have just done a site relaunch and am trying to determine if there are any other issues. I run an online store, and I have a mega menu with well over 300 links in it - makes the user experience really quick and easy to jump exactly where you want - and then I have about 30 links in the footer.

I know there's a 'no more than 100 links on a page' guideline for Moz, but does anyone know if Google is smart enough to see the same header / footer navigation structure on every page of a site and know it's navigation and not water down the rest of the links, or do I need to re-think and simplify my navigation?

It's one of those things that's there for a user experience and now I'm worried that I'm being penalised.

The site is www dot shopnaturally dot com dot au