Google search issue with exact domain
-
We had a site from Feb-2011 to Nov-2011 at the domain amcoexterminating.com. The site was pure HTML/CSS and the daily unique visitors steadily increased over that time. So all was fine.
We then moved the site to a CMS (Joomla) on Dec. 6th. From that day forward, the daily visitors went into the tank.
Before the move, if you typed "amcoexterminating.com" or "amco exterminating" into Google search, the site would be the first result (as you'd expect since those are the words that make up the actua domain). But we tried this yesterday and the site did not come up at all. NOT GOOD. It would work in Yahoo or Bing, but not in Google. So obviously, the problem with Google search directly affected the daily visitors.
We just checked Webmaster tools yesterday (yes, this should have been done sooner, lesson learned) and it said "Site has severe health issues - Important page blocked by robots.txt". It listed the "important" page URL and it was just a link to an image. Regardless, I wiped out the Joomla created robots.txt file and added a new one and made it just say...
User-agent: *Allow: /
About 14 hours later, after the new robots.txt file was recognized by Google, the "severe health" message went away. However if I search in Google for "amcoexterminating.com", it still doesn't show up and the client is concerned (as they should be).
Do you think the search engines just need more time to refresh? If so, once it refreshes, should the site show up first again right away?
Or is it possible the robots.txt file had nothing to do with the issue? If so, what other things could I check into that might cause Google search to not find a site even if you search for exact domain name?
Please share any and all things I should look into as I need to get this site showing in Google search again (as it was before moving to the CMS).
Thanks!
-
Sorry I never replied...It all looks good now.
-
Hi Rob,
How are things going on this site? Are your rankings back, or are you still looking for some help?
-
Yes thats all you needed to do.
it should come back, with ine a few weeks
-
Update: I found this code in my htaccess file...
Header set X-Robots-Tag "noindex, nofollow"
So I commented it out like so..
#Header set X-Robots-Tag "noindex, nofollow"
And resaved it.
I imagine this is all I needed to do. If you think I should have done something else, please let me know.
-
Thanks Robert, the answer to your two "Edit" questions is Yes (htaccess.txt was renamed to .htaccess and "seo friendly URLs" was selected as YES).
It makes sense that what Alan suspects is my main problem (i.e. there is a no-index, no-follow on the homepage) so I'm hoping he can point me in the right direction to correct it. If you know and see my reply before he does, please let me know
-
Thanks for the heads up on the canonical issues, will correct that.
As for this X-robots header, do you know where I can find that code to either change the no-index, no-follow to index, follow, or delete it completely? I tried to view what you said in IE, but when I click F12, the window that pops up doesn't have a "Networks" tab.
I am searching my site files for X-robots header and can't find this area, so if you could give me any insight on correcting this, I would be very appreciative. If that is the problem (and I trust that it is), I really gotta get it fixed ASAP
Side note you may not know: If I correct the X-robots header to be index, follow, should the site start showing up again in Google results immediately or could it take longer?
-
Rob, you have a problem. Or two.
First, somehow your images files are showing up and I believe this is causing a duplicate content issue. If I were to guess, I would say that you are new to joomla and may have set something up incorrectly. Without seeing your Joomla dashboard, it is hard to say exactly what is going on though.
When you do a Site:www.amcoexterminating.com or Site:amcoexterminating.com you get mostly images and pdfs. You also see excluded content and when you click on it you see the same.
The only site url that is not a pdf is http://www.amcoexterminating.com/images/ so Google is not seeing any other url. This is due to Robots.txt or bad site map, Joomla settings that control these, etc.
I wish I could be of more help, but without seeing what the settings are in the dashboard, I cannot find the issue (using firebug, etc.).
Best
Edit: Alan has some good info in his response. Also, in Joomla on the Global Configuration there is an SEO Settings near top on right. Within that is a selection for Use Apache mod_rewrite if you selected this did you rename htaccess.txt to .htaccess before you activated this?
Above it is a selection for search engine friendly urls, have you selected that? -
No I cant see one image blocked being the problem, you should not block images, js or css files that are used on pages that are not blocked, it is not a problem alone, but if there are any other signals of spam, then the fact that you hide these files is then seen as a suspicious signal.
I am not a fan of CMS, as they do not write clean code. I had a look at your site and found many problems. The worst is canonical issues, you home page rank is split between
http://www.amcoexterminating.com/index.php
http://www.amcoexterminating.com
http://amcoexterminating.com/index.php
http://amcoexterminating.comYou need to fix your canonical issues.
http://thatsit.com.au/seo/tutorials/how-to-fix-canonical-domain-name-issuesbut the reason you cant find your page in Google is you have a X-robots header of no-index, no-follow. You have a index, follow meta tag, but the header must be overruling it.
If you want to see this for yourself. in IE press F12, select the network tab and start capturing. Load your home page, then click on the home page url in the results and select response headers.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can I safely asume that links between subsites on a subdirectories based multisite will be treated as internal links within a single site by Google?
I am building a multisite network based in subdirectories (of the mainsite.com/site1 kind) where the main site is like a company site, and subsites are focused on brands or projects of that company. There will be links back and forth from the main site and the subsites, as if subsites were just categories or pages within the main site (they are hosted in subfolders of the main domain, after all). Now, Google's John Mueller has said: <<as far="" as="" their="" url="" structure="" is concerned,="" subdirectories="" are="" no="" different="" from="" pages="" and="" subpages="" on="" your="" main="" site.="" google="" will="" do="" its="" best="" to="" identify="" where="" sites="" separate="" using="" but="" the="" is="" same="" for="" a="" single="" site,="" you="" should="" assume="" that="" seo="" purposes,="" network="" be="" treated="" one="">></as> This sounds fine to me, except for the part "Google will do its best to identify where sites are separate", because then, if Google establishes that my multisite structure is actually a collection of different sites, links between subsites and mainsite would be considered backlinks between my own sites, which could be therefore considered a link wheel, that is, a kind of linking structure Google doesn't like. How can I make sure that Google understand my multisite as a unique site? P.S. - The reason I chose this multisite structure, instead of hosting brands in categories of the main site, is that if I use the subdirectories based multisite feature I will be able to map a TLD domain to any of my brands (subsites) whenever I'd choose to give that brand a more distinct profile, as if it really was a different website.
Web Design | | PabloCulebras0 -
NO Meta description pulling through in SERP with react website - Requesting Indexing & Submitting to Google with no luck
Hi there, A year ago I launched a website using react, which has caused Google to not read my meta descriptions. I've submitted the sitemap and there was no change in the SERP. Then, I tried "Fetch and Render" and request indexing for the homepage, which did work, however I have over 300 pages and I can't do that for every one. I have requested a fetch, render and index for "this url and linked pages," and while Google's cache has updated, the SERP listing has not. I looked in the Index Coverage report for the new GSC and it says the urls and valid and indexable, and yet there's still no meta description. I realize that Google doesn't have to index all pages, and that Google may not also take your meta description, but I want to make sure I do my due diligence in making the website crawlable. My main questions are: If Google didn't reindex ANYTHING when I submitted the sitemap, what might be wrong with my sitemap? Is submitting each url manually bad, and if so, why? Am I simply jumping the gun since it's only been a week since I requested indexing for the main url and all the linked urls? Any other suggestions?
Web Design | | DigitalMarketingSEO1 -
Do SEOs really need to care about trend in increase of voice search?
Hi all, Just browsing through the articles like "SEO trends in 2108"....I can see everyone mention about increase in voice search and attributing same to the SEO at top. But there is very less information on how to optimise for voice search....May be, they don't know what SEOs have to do exactly with voice search. Basically the input method is going to change on search and else remains same. This must be leading to increase of long tail searches and more search snippets to give an instant voice answer. What else has to be optimised to favoured in voice search? Thanks
Web Design | | vtmoz2 -
Mobile Friendly Issue
2 days ago I saw my site listed with the 'mobile friendly' text in the Mobile searches. Today it has vanished. I have checked my site using the Google tool and it shows my site as Mobile Friendly. Has anyone had a similar experience?
Web Design | | dynamyt1000 -
Does Google count the domain name in its 115-character "ideal" URL length?
I've been following various threads having to do with URL length and Google's happiness therewith and have yet to find an answer to the question posed in the title. Some answers and discussions have come close, but none I've found have addressed this with any specificity. Here are four hypothetical URLs of varying lengths and configurations: EXAMPLE ONE:
Web Design | | RScime25
my-big-widgets-are-the-best-widgets-in-the-world-and-come-in-many-vibrant-and-unique-colors-and-configurations.html (115 characters) EXAMPLE TWO: sample.com/my-big-widgets-are-the-best-widgets-in-the-world-and-come-in-many-vibrant-and-unique-colors-and-configurations.html (126 characters) EXAMPLE THREE: www.sample.com/my-big-widgets-are-the-best-widgets-in-the-world-and-come-in-many-vibrant-and-unique-colors-and-configurations.html (130 characters) EXAMPLE FOUR: http://www.sample.com/my-big-widgets-are-the-best-widgets-in-the-world-and-come-in-many-vibrant-and-unique-colors-and-configurations.html (137 characters) Assuming the examples contain appropriate keywords and are linked to appropriate anchor text (etc.,) how would Google look upon each? All I've been able to garner thus far is that URLs should be as short as possible while still containing and contextualizing keywords. I have 500+ URLs to review for the company I work for and could use some guidance; yes, I know I should test, but testing is problematical to the extreme; I look to the collective/accumulated wisdom of the MOZVerse for help. Thanks.1 -
How to verify http://bizdetox.com for google webmaster tools
Hey guys i tried to to make a Preferred Domain choice in webmaster tools, but it is not allowing me to save my choice bec its asking me to verify that i own http://bizdetox.com How do i go about doing that and what are the steps I have already verified www.bizdetox.com
Web Design | | BizDetox0 -
Rephrasing my question: I have no search traffic -- I would love some feedback
I just posted a question: http://www.seomoz.org/q/am-i-on-the-right-track-still-not-seeing-results-in-rank-traffic-etc An it already has 63 views and one response, but I think I may have phrased the question wrong. I would love a little feedback on my site - I have zero search traffic -- none. I find that odd. I am not sure if it "just takes time" and I need to be patient, or if I am doing something really obviously wrong. I have been really amazed by what I have read so far in this community, and have learned a ton. In my previous question, I listed all the things I am doing -- and I think I have the basics down pat. Should I not have at least 1 visitor per day? Any feedback would be appreciated. Thank you so much!!
Web Design | | WendyKKelly0 -
Aged .com domain or brand new .co.uk for UK site?
Should i buy a 2 year old .com domain or brand new .co.uk domain for a site i am making for UK (google.co.uk optimisation). I am struggling to find good aged .co.uk domains, there are loads of nice .com's that are old, any thoughts? thanks
Web Design | | SamBuck0