Thanks, you seem lucky to me.. Almost after 2 month i have got the code for making all these encoded url's redirect correctly. Finally, now if one types

http://www.mycarhelpline.com/\"/index.php?option=com_latestnews&view=list&Itemid=10

then he's redirected through 301 to the correct url

http://www.mycarhelpline.com/index.php?option=com_latestnews&view=list&Itemid=10

Sure, If i show you some url they are crawled as :-

Sample Incorrect URLs crawled and reported as duplicate one in Google Webmaster & Moz too

|

http://www.mycarhelpline.com/\"/index.php?option=com_latestnews&view=list&Itemid=10

| http://www.mycarhelpline.com/\"/index.php?option=com_newcar&view=category&Itemid=2 |

|

Correct URL

http://www.mycarhelpline.com/index.php?option=com_latestnews&view=list&Itemid=10

http://www.mycarhelpline.com/index.php?option=com_newcar&view=search&Itemid=2

What we found online

Since URLs often contain characters outside the ASCII set, the URL has to be converted into a valid ASCII format. URL encoding replaces unsafe ASCII characters with a "%" followed by two hexadecimal digits. URLs cannot contain spaces.

%22 reflects - " and %5c as \ (forward slash)

We intend to remove these duplicate one created having %22 and %5c within them..

Many thanks

i mentioned same only, The "User-agent: *" means this section applies to all robots. The "Disallow: /" tells the robot that it should not visit any pages on the site."

n has added - More and more people use robots,txt to disallow access to some administration or private folders of the site

Hi, This is what i got

" Web site owners use the /robots.txt file to give instructions about their site to web robots; this is called_The Robots Exclusion Protocol_. It works likes this: a robot wants to vists a Web site URL, say http://www.example.com/welcome.html. Before it does so, it firsts checks for http://www.example.com/robots.txt, and finds:

User-agent: *
Disallow: /

The "<tt>User-agent: *</tt>" means this section applies to all robots. The "<tt>Disallow: /</tt>" tells the robot that it should not visit any pages on the site."

More and more people use robots,txt to disallow access to some administration or private folders of the site . If you dont want to hide anything then may be you can leave it blank

Bit skeptical, as due to dynamic url and some other linkage issue, google has crawled url with backslash and asterisk character

ex - www.xyz.com/\/index.php?option=com_product

www.xyz.com/\"/index.php?option=com_product

Now %5c is the encoded version of \ - backslash & %22 is encoded version of asterisk

Need to know for command :-

User-agent: *   Disallow: \As am disallowing all backslash url through this - will it only remove the backslash url which are duplicates or the entire site,

Hi - Due to pagination

the default page of site is coming in 2 url with

- ?page=1/ sub-url

• and /sub-url

is 301 a recommended solution due to this pagination urls

Also - is it required to create separate title and meta description of every pagination page

We are taking specifically in context of our discounts and offer section

http://www.mycarhelpline.com/index.php?option=com_offers&view=list&Itemid=9