Google search issue with exact domain
-
We had a site from Feb-2011 to Nov-2011 at the domain amcoexterminating.com. The site was pure HTML/CSS and the daily unique visitors steadily increased over that time. So all was fine.
We then moved the site to a CMS (Joomla) on Dec. 6th. From that day forward, the daily visitors went into the tank.
Before the move, if you typed "amcoexterminating.com" or "amco exterminating" into Google search, the site would be the first result (as you'd expect since those are the words that make up the actua domain). But we tried this yesterday and the site did not come up at all. NOT GOOD. It would work in Yahoo or Bing, but not in Google. So obviously, the problem with Google search directly affected the daily visitors.
We just checked Webmaster tools yesterday (yes, this should have been done sooner, lesson learned) and it said "Site has severe health issues - Important page blocked by robots.txt". It listed the "important" page URL and it was just a link to an image. Regardless, I wiped out the Joomla created robots.txt file and added a new one and made it just say...
User-agent: *Allow: /
About 14 hours later, after the new robots.txt file was recognized by Google, the "severe health" message went away. However if I search in Google for "amcoexterminating.com", it still doesn't show up and the client is concerned (as they should be).
Do you think the search engines just need more time to refresh? If so, once it refreshes, should the site show up first again right away?
Or is it possible the robots.txt file had nothing to do with the issue? If so, what other things could I check into that might cause Google search to not find a site even if you search for exact domain name?
Please share any and all things I should look into as I need to get this site showing in Google search again (as it was before moving to the CMS).
Thanks!
-
Sorry I never replied...It all looks good now.
-
Hi Rob,
How are things going on this site? Are your rankings back, or are you still looking for some help?
-
Yes thats all you needed to do.
it should come back, with ine a few weeks
-
Update: I found this code in my htaccess file...
Header set X-Robots-Tag "noindex, nofollow"
So I commented it out like so..
#Header set X-Robots-Tag "noindex, nofollow"
And resaved it.
I imagine this is all I needed to do. If you think I should have done something else, please let me know.
-
Thanks Robert, the answer to your two "Edit" questions is Yes (htaccess.txt was renamed to .htaccess and "seo friendly URLs" was selected as YES).
It makes sense that what Alan suspects is my main problem (i.e. there is a no-index, no-follow on the homepage) so I'm hoping he can point me in the right direction to correct it. If you know and see my reply before he does, please let me know
-
Thanks for the heads up on the canonical issues, will correct that.
As for this X-robots header, do you know where I can find that code to either change the no-index, no-follow to index, follow, or delete it completely? I tried to view what you said in IE, but when I click F12, the window that pops up doesn't have a "Networks" tab.
I am searching my site files for X-robots header and can't find this area, so if you could give me any insight on correcting this, I would be very appreciative. If that is the problem (and I trust that it is), I really gotta get it fixed ASAP
Side note you may not know: If I correct the X-robots header to be index, follow, should the site start showing up again in Google results immediately or could it take longer?
-
Rob, you have a problem. Or two.
First, somehow your images files are showing up and I believe this is causing a duplicate content issue. If I were to guess, I would say that you are new to joomla and may have set something up incorrectly. Without seeing your Joomla dashboard, it is hard to say exactly what is going on though.
When you do a Site:www.amcoexterminating.com or Site:amcoexterminating.com you get mostly images and pdfs. You also see excluded content and when you click on it you see the same.
The only site url that is not a pdf is http://www.amcoexterminating.com/images/ so Google is not seeing any other url. This is due to Robots.txt or bad site map, Joomla settings that control these, etc.
I wish I could be of more help, but without seeing what the settings are in the dashboard, I cannot find the issue (using firebug, etc.).
Best
Edit: Alan has some good info in his response. Also, in Joomla on the Global Configuration there is an SEO Settings near top on right. Within that is a selection for Use Apache mod_rewrite if you selected this did you rename htaccess.txt to .htaccess before you activated this?
Above it is a selection for search engine friendly urls, have you selected that? -
No I cant see one image blocked being the problem, you should not block images, js or css files that are used on pages that are not blocked, it is not a problem alone, but if there are any other signals of spam, then the fact that you hide these files is then seen as a suspicious signal.
I am not a fan of CMS, as they do not write clean code. I had a look at your site and found many problems. The worst is canonical issues, you home page rank is split between
http://www.amcoexterminating.com/index.php
http://www.amcoexterminating.com
http://amcoexterminating.com/index.php
http://amcoexterminating.comYou need to fix your canonical issues.
http://thatsit.com.au/seo/tutorials/how-to-fix-canonical-domain-name-issuesbut the reason you cant find your page in Google is you have a X-robots header of no-index, no-follow. You have a index, follow meta tag, but the header must be overruling it.
If you want to see this for yourself. in IE press F12, select the network tab and start capturing. Load your home page, then click on the home page url in the results and select response headers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Have Your Thoughts Changed Regarding Canonical Tag Best Practice for Pagination? - Google Ignoring rel= Next/Prev Tagging
Hi there, We have a good-sized eCommerce client that is gearing up for a relaunch. At this point, the staging site follows the previous best practice for pagination (self-referencing canonical tags on each page; rel=next & prev tags referencing the last and next page within the category). Knowing that Google does not support rel=next/prev tags, does that change your thoughts for how to set up canonical tags within a paginated product category? We have some categories that have 500-600 products so creating and canonicalizing to a 'view all' page is not ideal for us. That leaves us with the following options (feel it is worth noting that we are leaving rel=next / prev tags in place): Leave canonical tags as-is, page 2 of the product category will have a canonical tag referencing ?page=2 URL Reference Page 1 of product category on all pages within the category series, page 2 of product category would have canonical tag referencing page 1 (/category/) - this is admittedly what I am leaning toward. Any and all thoughts are appreciated! If this were in relation to an existing website that is not experiencing indexing issues, I wouldn't worry about these. Given we are launching a new site, now is the time to make such a change. Thank you! Joe
Web Design | | Joe_Stoffel1 -
Multiple sites using same text - how to avoid Google duplicate content penalty?
Hi Mozers, my client located in Colorado is opening a similar (but not identical) clinic in California. Will Google penalize the new California site if we use text from our website that features his Colorado office? He runs the clinic in CO and will be a partner of the clinic in CA, so the CA clinic has his "permission" to use his original text. Eventually he hopes to go national, with multiple sites utilizing essentially the same text. Will Google penalize the new CA site for plagiarism and/or duplicate content? Or is there a way to tell Google, "hey Google, this new clinic is not ripping off my text"?
Web Design | | CalamityJane770 -
Fetch as Google not showing Waypoints.js on scroll animation
So I noticed that my main content underneath 4 reasons to choose LED Habitats did not show up in Fetch as Google as well as a few other sections. The site being brand new, so I'm not sure how this will be indexed. What happens is, as the user scrolls the content is brought in using Waypoints and Animate.css which offers an engaging yet simple user experience. I'm just afraid that If the content doesn't show up in "Fetch as Google" in webmaster tools that this content will never be found / indexed by Google. There are thousands of sites that use this library, I'm just curious what I'm doing wrong.. or what I can do. Is there a way for me to keep the simple animations but keep Google Happy at the same time? I took a screen shot of "Fetch as Google" and you can see blatant missing sections which are the sections animated by the waypoints library. Thanks for listening! Robert ZqgLWHi
Web Design | | swarming0 -
Do I need to 301 redirect www.domain.com/index.html to www.domain.com/ ?
So, interestingly enough, the Moz crawler picked up my index.html file (homepage) and reported duplicate content, of course. But, Google hasn't seemed to index the www.domain.com/index.html version of my homepage, just the www.domain.com version. However, it looks like I do have links going specifically to www.domain.com/index.html and I want to make sure those are getting counted towards my overall domain strength. Is it necessary to 301 redirect in the scenario described above?
Web Design | | Small_Business_SEO0 -
Accordion Fold Ups Bad For Google
http://fandicoach.com/products Right now I have these accordion things on the website. Are they bad for google in terms of being an SEO best practice? I want to avoid doing anything black hat. Thanks!
Web Design | | OOMDODigital0 -
Will google penalize a website for using a table layout?
I just got a new client today and his entire website layout and structure is using tables instead of divs. This client is on a tight budget and wants to avoid unnecessary hours for re-coding the website, but at the same time he wants me to improve his SEO organically. This is the first time I've been asked to do work on an existing website that uses pure tables for the entire layout and I'm wondering if this effects the SEO in any way. So my question is, will tables effect rankings and SEO in any way?
Web Design | | ScottMcPherson0 -
Show root domain (that is 301 redirected) in SERP?
Hi, If I have the domain name www.businessname.com.au pointing (using 301 redirect) to a particular page on a business directory site (eg www.bizdirectory.com.au/businessname), is it possible to have the URL www.businessname.com.au displayed in the Google search results rather than the destination page of www.bizdirectory.com.au/businessname? Thanks in advance,
Web Design | | blackrails
Adam0 -
Wordpress drop down menu issue...
While I am tweaking my current site with getting rid of my footer links, my site will not allow a drop down menu for my service area parent page. It will do a drop down menu for any other tab. Could not find anything in a google search besides just link to parent for drop down... Any ideas?
Web Design | | greenjoe0