Impact of 401s on Site Rankings
-
Will having 401s on a site negatively impact rankings? (e.g. 401s thrown from a social media sharing icon)
-
Hi! We're going through some of the older unanswered questions and seeing if people still have questions or if they've gone ahead and implemented something and have any lessons to share with us. Can you give an update, or mark your question as answered?
Thanks!
-
So how would you block spiders from crawling social media sharing icons? Or is there another workaround?
-
Yes, I believe any http error response is a bad thing and could affect your ranking. Even 404's or 301's (when links on-site or in sitemap cause them) are cause for concern. You want to make your site as squeaky clean as possible.
I regularly use a site crawler to check my site, including sitemap/rss feeds, and fix any non-200 responses.
-
First here is an error list: http://www.google.com/support/webmasters/bin/answer.py?hl=en&answer=40132
Response code 403 is for requests, where authentication makes no difference, disabled directory browsing.
401 Unauthorized would be the response to send.I'd suggest using robot.txt to stop going to these pages? Or even better, if you can allow Google's spiders access (I'm not 100% sure how this is done)
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Our client's site was owned by former employee who took over the site. What should be done? Is there a way to preserve all the SEO work?
A client had a member of the team leave on bad terms. This wasn't something that was conveyed to us at all, but recently it came up when the distraught former employee took control of the domain and locked everyone out. At first, this was assumed to be a hack, but eventually it was revealed that one of the company starters who unhappily left the team owned the domain all along and is now holding it hostage. Here's the breakdown: -Every page aside from the homepage is now gone and serving a 404 response code -The site is out of our control -The former employee is asking for a $1 million ransom to sell the domain back -The homepage is a "countdown clock" that isn't actively counting down, but claims that something exciting is happening in 3 days and lists a contact email. The question is how we can save the client's traffic through all this turmoil. Whether buying a similar domain and starting from square one and hoping we can later redirect the old site's pages after getting it back. Or maybe we have a legal claim here that we do not see even though the individual is now the owner of the site. Perhaps there's a way to redirect the now defunct pages to a new site somehow? Any ideas are greatly appreciated.
Technical SEO | | FPD_NYC0 -
Awful ranking after site redesign
Hello everyone, I have a situation here and I’d like to have your opinion about it. I am working on a site which has been recently redesigned from scratch: in a nutshell, as soon as the new site went live their rankings dropped and, of course, so did their visitors and so on.. The guys who redesigned the site didn’t do any 301 redirect whatsoever, so now the old pages are just 404s and blocked by robots. My question is: if they 301 redirect now, do you think it would be possible they could get their rankings back? One more thing: when they launched the new site, the indexed pages basically doubled overnight; there were 700 and now there are 1400. Do you think this could affect their ranking as well? Thank you for you insights 🙂 Elio
Technical SEO | | Eyah0 -
If I want clean up my URLs and take the "www.site.com/page.html" and make it "www.site.com/page" do I need a redirect?
If I want clean up my URLs and take the "www.site.com/page.html" and make it "www.site.com/page" do I need a redirect? If this scenario requires a 301 redirect no matter what, I might as well update the URL to be a little more keyword rich for the page while I'm at it. However, since these pages are ranking well I'd rather not lose any authority in the process and keep the URL just stripped of the ".html" (if that's possible). Thanks for you help! [edited for formatting]
Technical SEO | | Booj0 -
Site Migration Questions
Hello everyone, We are in the process of going from a .net to a .com and we have also done a complete site redesign as well as refreshed all of our content. I know it is generally ideal to not do all of this at once but I have no control over that part. I have a few questions and would like any input on avoiding losing rankings and traffic. One of my first concerns is that we have done away with some of our higher ranking pages and combined them into one parallax scrolling page. Basically, instead of having a product page for each product they are now all on one page. This of course has made some difficulty because search terms we were using for the individual pages no longer apply. My next concern is that we are adding keywords to the ends of our urls in attempt to raise rankings. So an example: website.com/product/product-name/keywords-for-product if a customer deletes keywords-for-product they end up being re-directed back to the page again. Since the keywords cannot be removed is a redirect the best way to handle this? Would a canonical tag be better? I'm trying to avoid duplicate content since my request to remove the keywords in urls was denied. Also when a customer deletes everything but website.com/product/ it goes to the home page and the url turns to website.com/product/#. Will those pages with # at the end be indexed separately or does google ignore that? Lastly, how can I determine what kind of loss in traffic we are looking at upon launch? I know some is to be expected but I want to avoid it as much as I can so any advice for this migration would be greatly appreciated.
Technical SEO | | Sika220 -
Ranking in Bing
My frustration with Google currently has led me to try bing out more. I don't rank as good in bing as Google, so I was wondering if anyone had any great tips of what bing looks for to rank website well? So far I can see they seem to favour keyword domains, take 'cheap holidays' for example. Always reading about what Google want but what do bing want? Any advice much appreciated.
Technical SEO | | pauledwards0 -
How Often is Site Crawled
Good morning- I saw some errors in my first crawl and immediately removed the pages from my website. I then re-created my XML sitemap and uploaded to Google. The question I have is will the site be crawled to recognize the changes in the next day or so? The pages were just placed on the site as test pages and never removed. The initial crawl that notified me it was done found the errors and were removed. Thanks for your help. Peter
Technical SEO | | VT_Pete0 -
Ranking Internationally
Whats the best URL strategy to rank for one term in different countries? We currently rank well in Australia, but are tackling many countries over the next few months. The page I am ranking is http://www.spendbitcoins.com/buy for the term 'buy bitcoins' or 'buy bitcoins in Australia' (replace Australia with each specific country, i.e. New Zealand, Japan, etc.) These are the strategies I have come up with, is one of these good or is there a different better way? Use country specific TLDs, pulling the content from the same site w/ translations Use country specific TLDs and create separate sites and create completely original content Use country specific TLDs, forwarding to the primary domain use a subdomain from the same site modify the page link to be something like spendbitcoins.com/buy/new-zealand Don't worry about any of this and just get links from sites with the proper TLD
Technical SEO | | jaychristopher0 -
Site revision
our site has complete redesign including site architecture, page url and page content (except domain). It looks like a new site. The old site has been indexed about thirty thousand results by google. now what should i do first?
Technical SEO | | jallenyang0