Severe Health issue on my site through Webmaster tools
-
I use Go Daddy Website Tonight. I keep getting a severe health message in Google Webmaster tools stating that my robots.txt file is blocking some important page. When I try to get more details the blocked file will not open. When I asked the Go Daddy peeps they told me that it was just image and backup files that do not need to be crawled. But if Google spiders keep thinking an important page is blocked will this hurt my SERPS?
-
I would just like to add: If you're considering signing up for something (SEV), you may as well get a real hosting package.
-
Thanks for letting us know, and glad you found a work-around. A 0-second META REFRESH sometimes acts like a 301 - it's not ideal, as you said, but it's something.
-
For anyone else with Website Tonight, I have finally found a work around if not a fix. Being that Website Tonight will not allow you to do a 301 Redirect of an old page, I have figured out that if you re-create the deleted page (just the URL not the content) and use the Meta Tag to do a REFRESH to the new page, anytime the old page is clicked on it will bring them to the new page. Not ideal, of course, for SEO purposes but at least they are no longer going to a 404 and HOPEFULLY your old link juice will pass on.
-
While creating the copy of the home-page isn't ideal, if Google hasn't indexed it, it's very likely not creating duplicate content problems. Either they're filtering it out or haven't indexed it at all (since it probably has no links/paths).
I don't think that this alone is the cause of your ranking drop, but you've got a few things going on, so it's tough to say. Unfortunately, most of the ideal solutions seem to be impossible in the Godaddy system, and that's going to continue to cause you some problems.
-
No I have not made any changes yet. Google has never preferred the /shakeology.html page. I don't think it's ever been indexed. My only problem is that since I tried to CHANGE the root url not CREAT ANOTHER VERSION my serps have seemed to tank and I am trying to avoid the duplicate content issues that I believe the /shakeology.html is causing.
-
No I have not made any changes yet. Google has never preferred the /shakeology.html page. I don't think it's ever been indexed. My only problem is that since I tried to CHANGE the root url not CREAT ANOTHER VERSION my serps have seemed to tank and I am trying to avoid the duplicate content issues that I believe the /shakeology.html is causing.
-
It's a bit dangerous to simply block "shakeology.html", if Google has preferred it for a reason - you could end up getting your root page back in the rankings, or you could end up just falling out completely. I think you'd be better off leaving it and having the "wrong" page rank, if that's the only viable option.
I'm actually still showing your root home-page ranking, though, and now the "shakeology.html" page isn't even appearing in the index. Did you already make a change?
-
My original wanted homepage is www .hompage .com
My duplicate is www. hompage .com/shakeology.html
Would it be possible and/or advisable to use a Parameter in Web Master tools to ignore the /shakeology.html?
-
Unfortunately, there just comes a point where sometimes these very narrow CMS systems hit their limits, and it can start to harm you. I don't know Website Tonight well enough to help on that (hopefully someone else does), but there may come a point where you want to consider to a more advanced platform. These days, there are a lot of options that aren't budget-breakers, although switching is always a bit tough.
-
Unfortunately no. The edit page section of Website Tonight only shows the newer homepage.com/shakeology.html version and not the original homepage.com
I am afraid to delete the homepage.com/shakeology.html in fear that I will be left with neither one.
You probably aren't seeing the preview of the .com/shakeology.html because it is not the indexed homepage. It shows for the homepage.com version. The canonical tag was me trying to redirect search engines from the new (unwanted) homepage to the original because Website tonight won't allow me to 301 it.
-
Sounds like SEO Executive has got you covered on the Godaddy front - just wanted to point out a couple of things:
(1) I'm not seeing a preview for your home-page, and I had trouble connecting to it the first time. It seems to be cahced, so this could be a fluke.
(2) Not sure if this is part of the Godaddy code, but there's a really weird tag on the home-page:
name="canonical tag" content=""/>
That might just be a reference, but it doesn't do anything. If it's supposed to actually be a canonical, then something is broken.
-
Yes I saw that but unfortunately the organize your site page on website tonight only shows the new page. I'm afraid to delete it and lose both.
-
I found some great info here that I believe explains it: http://support.godaddy.com/help/2986/organizing-your-website-using-the-organize-site-page
-
I really do appreciate all of your help. Here's the issue I'm having with this though... After I renamed the homepage file to add /shakeology.html to it (because I thought it would be beneficial to have a main keyword in the url) Website Tonight only shows me the homepage.com/shakeology.html and not the homepage.com. I'm afraid that if I delete /shakeology.html I will show neither one and in essence, according to Website Tonight just be deleting my homepage. I'm not sure how to properly accomplish what I'm looking to do without screwing myself any further??
-
Personally, that's what I would do is delete it. Unless, there is a reason you need that page.
-
Since I can't 301 it, would it be bad to delete the dupe page?
-
Yes thanks. I foolishly renamed my home page and caused a duplicate page. Website tonight will not allow me to do a 301 redirect. I put a canonical tag on the /shakeology. Should this do the trick?
-
Your welcome! I'm also sending the other side of the story not to confuse you but to allow you to make a decision based on both sides: http://groups.google.com/a/googleproductforums.com/forum/#!category-topic/webmasters/crawling-indexing--ranking/8nyxCtv9RHM
-
Oh OK great. Thanks so much for your help. I just got nervous because Google puts up the Severe Health Issue warning everytime I get crawled.
-
This is a javascript file and I don't see it being an issue unless Google thinks your hiding it to be spammy . Also, there are some that say it's a benefit to block js files from the search for SEO purposes. Here is an example of that situation: http://www.seomofo.com/advanced/do-not-let-google-crawl-javascript.html I think since this is out of your control and goes by the standard of how Godaddy sets up there sites, then it shouldn't be an issue.
-
It was just crawled. And it was after robots.txt was uploaded. This is the page it lists: siteUtil.js
-
Also, the following are duplicates: http://www.shakes4life.com/shakeology.html & http://www.shakes4life.com
-
When did Google last index your site? You can check this through webmaster tools. When did you instal the robots.txt file. The reason I ask: If Google's last crawl was before you uploaded your robots file then that could be the issue. Please look at these statistics and verify this before we move further.
-
Is Google webmaster tools giving you the specific name of the files that are being blocked?
-
Is there something on it that would be detrimental to my SERPS?
-
Yes. When I type www.shakes4life.com/robots.txt the same list shows.
-
Can you place the following in your browser and replace website with your domain name and www or non www in front. website.com/robots.txt
Let me know if you see the same stuff you sent me in your last response
-
Below is the robots.txt Website Tonight Creates when I tell it to allow all pages:
User-agent: *
Allow: /
User-agent: *
Disallow: /cache/
Disallow: /_backup/
Disallow: /_mygallery/
Disallow: /_temp/
Disallow: /_tempalbums/
Disallow: /_tmpfileop/
Disallow: /dbboon/
Disallow: /Flash/
Disallow: /images/
Disallow: /plugins/
Disallow: /scripts/
Disallow: /stats/
Disallow: /statshistory/
Disallow: /WstxSearchResults.html
Disallow: /WstxSearchResults.php
Disallow: /QSC/ -
Yes you are correct. I forgot to mention (sorry) that I do use S.E.V. It allows you to create a robots.txt and lets you choose pages to block. However, even when you choose allow all, by default it blocks certain files. Go Daddy tells me they are only system files but Google tells me an important page is blocked.
-
From what I know, Godaddy Website Tonight does not offer you the opportunity to create a custom robots.txt. I believe you have to sign up for there Search Engine Visibility services. Here is some more information: http://support.godaddy.com/help/article/5321
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Homepage indexation issue
Hello all, I've been scratching my head about this one for a while now... Let me explain the situation. I'm working on a multi-lingual website. Visitors are redirected (301) when they visit the homepage to the correct domain.com/en/default.html, domain.com/nl/default.html, domain.com/fr/default.html or domain.com/de/default.html based on browser language. I have doubts about the impact on the ability for Google to index the website because of that, but that's a problem for another day. The problem I'm having right now, is that domain.com/nl/default.html, domain.com/de/default.html and domain.com/fr/default.html are all indexed. When I search for the URL in Google I get the correct page on number one so I'm pretty sure those are indexed correctly. When I search for domain/en/default.html though, the homepage appears without /en/default.html extension. Does this mean Google assumes the domain.com page is the same as domain.com/en/default.html even though the redirect that's in place? Would be great if someone could shed some light on this. Thanks in advance!
Technical SEO | | buiserik0 -
Dealing with 410 Errors in Google Webmaster Tools
Hey there! (Background) We are doing a content audit on a site with 1,000s of articles, some going back to the early 2000s. There is some content that was duplicated from other sites, does not have any external links to it and gets little or no traffic. As we weed these out we set them to 410 to let the Goog know that this is not an error, we are getting rid of them on purpose and so the Goog should too. As expected, we now see the 410 errors in the Crawl report in Google Webmaster Tools. (Question) I have been going through and "Marking as Fixed" in GWT to clear out my console of these pages, but I am wondering if it would be better to just ignore them and let them clear out of GWT on their own. They are "fixed" in the 410 way as I intended and I am betting Google means fixed as being they show a 200 (if that makes sense). Any opinions on the best way to handle this? Thx!
Technical SEO | | CleverPhD0 -
Site Indexed but not Cached?
I launched a new website ~2 weeks ago that seems to be indexed but not cached. According to Google Webmaster most of the pages are indexed and I see them appear when I search site:www.xxx.com. However, when I type into the URL - cache:www.xxx.com I get a 404 error page from Google.
Technical SEO | | theLotter
I've checked more established websites and they are cached so I know I am checking correctly here... Why would my site be indexed but not in the cache?0 -
Any need to worry about spammy links in Webmaster Tools from sites that no longer exist?
I own an ecommerce website that had some spammy stuff done on it by an SEO firm through SEOLinkVine a few years ago. I'm working on removing all those links, but some of the sites no longer exist. I'm assuming I don't have to worry about disavowing those in Webmaster Tools? Thanks!
Technical SEO | | CobraJones950 -
Crawling issues in google
Hi everyone, I think i have crawling issues with one of my sites. It has vanished form Google rankings it used to rank for all services i offered now it doesn't anymore ever since September 29th. I have resubmitted to Google 2 times and they came back with the same answer: " We reviewed your site and found no manual actions by the web spam team that might affect your site's ranking in Google. There's no need to file a reconsideration request for your site, because any ranking issues you may be experiencing are not related to a manual action taken by the webspam team. Of course, there may be other issues with your site that affect your site's ranking. Google's computers determine the order of our search results using a series of formulas known as algorithms. We make hundreds of changes to our search algorithms each year, and we employ more than 200 different signals when ranking pages. As our algorithms change and as the web (including your site) changes, some fluctuation in ranking can happen as we make updates to present the best results to our users. If you've experienced a change in ranking which you suspect may be more than a simple algorithm change, there are other things you may want to investigate as possible causes, such as a major change to your site's content, content management system, or server architecture. For example, a site may not rank well if your server stops serving pages to Googlebot, or if you've changed the URLs for a large portion of your site's pages. This article has a list of other potential reasons your site may not be doing well in search. " How i detected that it may be a crawling issue is that 2 weeks ago i changed metas - metas are very slow in getting updated and for some of my pages never did update Do you know any good tools to check for bad code that could slow down the crawling. I really don't know where to look other than issues for crawling. I validated the website with w3c validator and ran xenu and cleaned these up but my website is still down. Any ideas are appreciated.
Technical SEO | | CMTM0 -
Can we use our existing site content on new site?
We added 1000s of pages unique content on our site and soon after google release penguin and we loose our ranking for major keywords and after months of efforts we decided to start a new site. If we use all the existing site content on new domain does google going to penalized the site for duplicate content or it will be treated as unique? Thanks
Technical SEO | | mozfreak0 -
Issue with Joomla Site not showing in SERP's
Site: simpsonelectricnc dot com I'm working on a Joomla website for a local business that isn't ranking at all for any relevant keyword - including the business name. The site is only about six months old and has relatively few links. I realize it takes time to compete for even low-volume keywords, but I think something else may be preventing the site from showing up. The site is not blocked by Robots.txt (which includes a valid reference to the sitemap)
Technical SEO | | CGR-Creative
There is no duplicate content issue, the .htaccess is redirecting all non-www traffic to www version
Every page has a unique title and H1 tag.
The URL's are search-engine friendly (not dynamic either)
XML sitemap is live and submitted to Google WM Tools. Google shows that it is indexing about 70% of the submitted URL's. The site has essentially no domain authority (0.02) according to Moz - I'm assuming this is due to lack of links and short life on the web.
Until today, 98% of the pages had identical meta descriptions. Again, I realize six months is not an eternity - but the site will not even show up for "business name + city,state" searches in Google. In fact, the only way I've seen it in organic results is to search for the exact URL. I would greatly appreciate any help.0