Hi Serge, I came to know about the "robots_ssl.txt" from the website http://www.seoworkers.com/seo-articles-tutorials/robots-and-https.html
Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.

Posts made by mediabase
-
RE: Duplicate content and http and https
-
RE: Duplicate content and http and https
Hello Hawkvt1, Fisrt of all I want to tell you that the protocols (http/https) are different, they are considered two separate sites, so there’s a good chance to get penalized for duplicate content. If the search engine discovers two identical pages, generally it would take the page it saw first and ignore the other pages.The solutions are described below:
S__olutions:
- Be smart about the site structure: to keep the engines from crawling and indexing HTTPS pages, structure the website so that HTTPs are only accessible through a form submission (log-in, sign-up, or payment pages). The common mistake is making these pages available via a standard link (happens when you are either ignorant or not aware that the secure version of the site is being crawled and indexed).
- Use Robots.txt file to control which pages will be crawled and indexed
- Use.htaccess file. Here’s how to do this:
- Create a file names robots_ssl.txt in your root.
- Add the following code to your .htaccessRewriteCond %{SERVER_PORT} 443 [NC]RewriteRule ^robots.txt$ robots_ssl.txt [L]
- Remove yourdomain.com:443 from the webmaster tools if the pages have already been crawled
- For dynamic pages like php, try< ?phpif ($_SERVER["SERVER_PORT"] == 443){echo “< meta name=” robots ” content=” noindex,nofollow ” > “;}?>
- Dramatic solution (may not always be possible): 301 redirect the HTTPS pages to the HTTP pages – with hopes that the link juice will transfer over.
For more information please refer to this link :
http://www.seomoz.org/ugc/solving-duplicate-content-issues-with-http-and-https
I'm sure that your problem is solved.
-
RE: Is the SORBS-SPAM list a big deal?
Hi Ayetti, Fisrtly Spamfighting is very important for reducing the amount of spam we'll all receive in the future but it doesn't do much to affect your spam intake for today. This section looks at some popular methods that are used to reduce the amount of spam currently ending up in mailboxes.
The SORBS considered to be the harmful. For more detail please refer to this link http://blog.wordtothewise.com/2010/12/gfi-sorbs-considered-harmful/
For the prevention of Spam prevention we gad to follow some useful steps & that are mentioned in following link http://www.sorbs.net/spamfo/prevention.shtml
-
RE: Does redesigning the website effects the SEO?
Hi Prasanth, I want to tell you that when websites are redesigned usually everyone is very focused on how it looks: the layout, the colors, the design-related images and so on. Changing these things usually doesn’t have a huge impact on search engine optimization. Search engines, being blind, don’t care much about what color your site is. They just read through the HTML and catalog the content.
The aspect of a website redesign that has a large impact on SEO is the site architecture. Site architecture deals with how many pages you have and how those pages are organized.
Changing the way your website looks shouldn’t have a big impact on your search rankings but changing the number and organization of pages can have a a big impact on your search rankings.
For more information please refer to the following link.
http://thoughtfaucet.com/making-things/how-to/website-redesign-seo-checklist/
-
RE: Do you suggest a SEO Plug-in for Dreamweaver?
Hi Naghirniac, As you mentioned above that you need a SEO plugin for Dreamweaver, so here's a SEO Assistant is Adobe Dreamweaver plugin that will show you how well the web page you are developing will rank for given keywords in major search engines.
Here is the link which gives you all the deatils, Please check & review it.