Google search issue with exact domain
-
We had a site from Feb-2011 to Nov-2011 at the domain amcoexterminating.com. The site was pure HTML/CSS and the daily unique visitors steadily increased over that time. So all was fine.
We then moved the site to a CMS (Joomla) on Dec. 6th. From that day forward, the daily visitors went into the tank.
Before the move, if you typed "amcoexterminating.com" or "amco exterminating" into Google search, the site would be the first result (as you'd expect since those are the words that make up the actua domain). But we tried this yesterday and the site did not come up at all. NOT GOOD. It would work in Yahoo or Bing, but not in Google. So obviously, the problem with Google search directly affected the daily visitors.
We just checked Webmaster tools yesterday (yes, this should have been done sooner, lesson learned) and it said "Site has severe health issues - Important page blocked by robots.txt". It listed the "important" page URL and it was just a link to an image. Regardless, I wiped out the Joomla created robots.txt file and added a new one and made it just say...
User-agent: *Allow: /
About 14 hours later, after the new robots.txt file was recognized by Google, the "severe health" message went away. However if I search in Google for "amcoexterminating.com", it still doesn't show up and the client is concerned (as they should be).
Do you think the search engines just need more time to refresh? If so, once it refreshes, should the site show up first again right away?
Or is it possible the robots.txt file had nothing to do with the issue? If so, what other things could I check into that might cause Google search to not find a site even if you search for exact domain name?
Please share any and all things I should look into as I need to get this site showing in Google search again (as it was before moving to the CMS).
Thanks!
-
Sorry I never replied...It all looks good now.
-
Hi Rob,
How are things going on this site? Are your rankings back, or are you still looking for some help?
-
Yes thats all you needed to do.
it should come back, with ine a few weeks
-
Update: I found this code in my htaccess file...
Header set X-Robots-Tag "noindex, nofollow"
So I commented it out like so..
#Header set X-Robots-Tag "noindex, nofollow"
And resaved it.
I imagine this is all I needed to do. If you think I should have done something else, please let me know.
-
Thanks Robert, the answer to your two "Edit" questions is Yes (htaccess.txt was renamed to .htaccess and "seo friendly URLs" was selected as YES).
It makes sense that what Alan suspects is my main problem (i.e. there is a no-index, no-follow on the homepage) so I'm hoping he can point me in the right direction to correct it. If you know and see my reply before he does, please let me know
-
Thanks for the heads up on the canonical issues, will correct that.
As for this X-robots header, do you know where I can find that code to either change the no-index, no-follow to index, follow, or delete it completely? I tried to view what you said in IE, but when I click F12, the window that pops up doesn't have a "Networks" tab.
I am searching my site files for X-robots header and can't find this area, so if you could give me any insight on correcting this, I would be very appreciative. If that is the problem (and I trust that it is), I really gotta get it fixed ASAP
Side note you may not know: If I correct the X-robots header to be index, follow, should the site start showing up again in Google results immediately or could it take longer?
-
Rob, you have a problem. Or two.
First, somehow your images files are showing up and I believe this is causing a duplicate content issue. If I were to guess, I would say that you are new to joomla and may have set something up incorrectly. Without seeing your Joomla dashboard, it is hard to say exactly what is going on though.
When you do a Site:www.amcoexterminating.com or Site:amcoexterminating.com you get mostly images and pdfs. You also see excluded content and when you click on it you see the same.
The only site url that is not a pdf is http://www.amcoexterminating.com/images/ so Google is not seeing any other url. This is due to Robots.txt or bad site map, Joomla settings that control these, etc.
I wish I could be of more help, but without seeing what the settings are in the dashboard, I cannot find the issue (using firebug, etc.).
Best
Edit: Alan has some good info in his response. Also, in Joomla on the Global Configuration there is an SEO Settings near top on right. Within that is a selection for Use Apache mod_rewrite if you selected this did you rename htaccess.txt to .htaccess before you activated this?
Above it is a selection for search engine friendly urls, have you selected that? -
No I cant see one image blocked being the problem, you should not block images, js or css files that are used on pages that are not blocked, it is not a problem alone, but if there are any other signals of spam, then the fact that you hide these files is then seen as a suspicious signal.
I am not a fan of CMS, as they do not write clean code. I had a look at your site and found many problems. The worst is canonical issues, you home page rank is split between
http://www.amcoexterminating.com/index.php
http://www.amcoexterminating.com
http://amcoexterminating.com/index.php
http://amcoexterminating.comYou need to fix your canonical issues.
http://thatsit.com.au/seo/tutorials/how-to-fix-canonical-domain-name-issuesbut the reason you cant find your page in Google is you have a X-robots header of no-index, no-follow. You have a index, follow meta tag, but the header must be overruling it.
If you want to see this for yourself. in IE press F12, select the network tab and start capturing. Load your home page, then click on the home page url in the results and select response headers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
How does ARIA-hidden text appear to search engines
I'm having trouble getting my accessibility team to add alt text to our site's images for SEO benefits as they feel some of it would add additional noise for screen readers. They proposed using ARIA-hidden attributes to hide the text but I'm wondering if will that be interpreted as a cloaking tactic to search engines? Also, I'm wondering if it the alt text will carry the same weight if ARIA-hidden is used. Has anyone had any experience with this? I'm having trouble finding any research on the topic.
Web Design | | KJ6001 -
Creating a new website, but I'd like to control it under a different domain.
I'd like to control it under the domain of another website with a higher DA. Can I create the new website (website A) and do an immediate re-direct to another website (website B)? Or would I be better at putting it as a subdomain? Such as www.websitea.websiteb.com? Cheers all, Rhys
Web Design | | SwanseaMedicine0 -
Wordpress themes causing google penalty(need experts to settle a debate)
Hi, I have been having a disagreement with another online marketing company. We are both promoting the same product under a different brand name but we ended up using the same theme to build our WordPress sites off of but in no way is the content the same. They are telling me that using the same theme in the same industry will cause a Google penalty. I do not believe this and do not see this causing a problem. The sites are relatively new so there is no proof of traffic dropping or penalties as of yet. What is everyone's professional opinion on this? Can a WordPress theme cause duplicate content penalty? If so would that not mean that anyone using themes will have some sort of penalty?
Web Design | | impact891 -
Are URL suffixes ignored by Google? Or is this duplicate content?
Example URLs: www.example.com/great-article-on-dog-hygiene.html www.example.com/great-article-on-dog-hygiene.rt-article.html My IT dept. tells me the second instance of this article would be ignored by Google, but I've found a couple of instances in which Google did index the 'rt-article.html' version of the page. To be fair, I've only found a couple out of MANY. Is it an issue? Thanks, Trisha
Web Design | | lzhao0 -
New website and new domain
Hi, We have a domain with current e-commerce site on, about 5 years old. We have a new website being built with a different company and a new domain name. We are transferring our old domain over to new provider and 301'ing the domain to new domain. However, we can not take the current website with us, so we lose all our links/pages etc.. How important would it be to take a wrap of our current website to keep all the pages alive? Is there anything we can do so oldurl.com/brand/tshirt/ doesnt lose its rank? Can we 301 individual pages if we dont have the actual website? Just the domain name. Any help be great. Thanks
Web Design | | YNWA0 -
Buying mutliple keyword rich domain names and directing them to one site
I've noticed some folks buying keyword rich domain names and pointing them to one site to try to rank for those keywords. An example of this is a plumbing business that buys domains like austinplumber.com, localaustinplumbingservice.com, bestplumberinaustin.com and then pointing these domains to their main website. Does this help the site rank for these key phrases? How does google see this? Thanks mozzers! Ron
Web Design | | Ron100 -
What is the new Google SERP highlighting?
My question is with the new Google SERP. I posted a pic of it at http://www.hortonwebdesign.com/images/new-google-page.gif. If you mouse over the arrows to the right of a result on the SERP, it pops up a preview of the page. On some results it also highlights a section of the page with a red box. What does this represent? Does it represent a key area that they are looking at in determining the positioning? I have some clients that are asking me and it doesn't make a lot of sense. In my example above I searched for "seo expert in georgia" and on my result (I'm #2), it shows a preview, but the part it has chosen to highlight with a red box is just, um, ...useless. It's highlighting a Recent Post sidebar on the right halfway down the page. Surely this can't be what they're looking at as what they view as "useful" to that search. This simply can't be what they're using to determine positioning. Or is it? Just please explain what I'm seeing here. new-google-page.gif.
Web Design | | GeorgiaSEOServices0 -
Any reaction to the announcement from Google that 'signed in' searches won't pass through search query info to analytics?
Seems like SEO is about to get that much harder: http://analytics.blogspot.com/2011/10/making-search-more-secure-accessing.html Any thoughts on this?
Web Design | | PaulM011