Organic traffic still down 9 months after redesign
-
The Good: We redesigned our nature travel website (www.ietravel.com) in Drupal. Overall, it's a great improvement in look and usability. Also, we are ranking for more relevant search terms (the SEO was managed by an agency before, and there were a lot of junk terms in their campaigns that weren't converting).
The Bad: Organic search referrals have consistently been down 10-20% year-over-year each and every month.
The Ugly: I am trying to dig in and figure out why this is happening, and I'm at a loss. We are aggressively publishing to our blog 5 days a week, and I've built many keyword-focused landing pages.
Here's what I do know in terms of things that could be problems which I've seen in Webmaster Tools and SEOmoz tools.
-
I have a lot of files restricted by robots.txt - 1,337 of them. Many have to be that way by design because they are nodes generated by web forms (w/ private user data). The rest are "Dates & Rates" pages - I restricted them because for each destination they are very similar in content. Wondering now if that was a mistake. For example, http://www.ietravel.com/central-south-america/galapagos-islands/dates-rates
-
We have duplicate title tags on 462 pages. The Lightbox Module that was installed for our photo galleries was a disaster. I am researching a more SEO-friendly solution, but that solution is a month or more away.
-
We have 31 duplicate meta descriptions.
My question is, could these errors be THAT significantly impacting our rankings?
I should note that according to Google Analytics, Referral traffic & Direct traffic is also year-over-year every month since the redesign. I don't understand the Referral part especially, since we took great pains to put in many 301 redirects. There are no 404s or non-indexable pages showing up in Webmaster Tools either.
If anyone has any suggestions for problem areas or red flags I should investigate, please let me know. Really, any thoughts are appreciated.
Best,
Carlton
-
-
My company site is built in Joomla. It is undergoing a few changes including updating to HTML 5 / CSS 3 and a complete redesign. When it is 100% complete and ready to launch, I will put the site forth for discussion on this very topic. I have always worked to ensure we use valid code and so forth, but I have not used Microsoft's IIS tool to check for violations. At Alan's suggestion, I will do so for this site. I contend a professionally developed Jooma / WordPress / Drupal / etc site can perform as well as a hand-coded site BUT 95%+ of CMS sites are not professionally developed in my experience.
Just because a site owner hired a web developer to create the site does not mean it was professionally developed any more than hiring an SEO for consulting means you will receive professional results. This is my take on the topic. I am sure there are countering views.
-
This is perfect Ryan, just the type of response I was hoping to find. My website is a database driven website and my opinion has been that the platform does not have nearly as much influence (if any) on organic rankings as the SEO working on the site.
In most every case where I've found an SEO related issue in a open source cms someone else has experienced it too and has already built a solution...and if it's new technology, like you said, an extension is usually soon to follow. The main concern I had and criticism I am trying to refute is that "because my site is built in drupal, it cannot/will not ever perform as well as a static HTML non-dynamic site"
I think your response helped answer this question, but I'd always be interested in additional feedback and other SEOMoz opinions on this matter. I was going to start my own post on this topic, but it seemed to fit so well with this ongoing discussion.
Thanks
-
**On a purely apples to apples comparison of sites from Static HTML vs CMS does HTML still have an advantage? **
Yes and No. It depends on what kind of advantages you refer to. Do you mean cleaner code? Faster updates? Costs to manage? Time? Ranking?
A CMS outputs HTML code. Whether you use Drupal, Joomla, WordPress, .NET or one of the dozens of other CMS, HTML code is being output. The code that is output will always be conformed to specific standards based on the CMS.
The good - the code can always be adjusted.
The bad - you may have to alter core files which would need to be reviewed after every CMS update.
An example: when Google introduces a new feature (authorship, canonical urls, etc) if you have a static html site you simply add the new code and you are done. With a CMS the changes are more complex. With that said, you can usually wait a short bit and someone will create an extension, or update an existing extension, which will offer that functionality.
If we move from theoretical to practical, most CMS-based websites are not professionally developed or maintained. Accordingly, there are tons of coding issues which cause a variety of problems.
Are you asking about a dynamic (i.e. database driven) site vs a static site? If so, a database driven site would have advantages of being able to offer a local search widget whereas a static site would not be able to offer that feature. That is just one example.
-
This is great feedback. I too have my site on Drupal and have had multiple SEOs tell me that a CMS-driven site will not rank as well as a static HTML site. My question is this, if you had the exact same site on Drupal or any other CMS vs the same content on a traditional static HTML site, is there anything inherently inferior to the CMS site as it relates to SEO? I realize back before CMS had the ability to serve search engine friendly URLS and before canonical link tag was introduced the CMS could be considered sloppy and full of duplicate content, but that argument doesn't seem to hold as much merit anymore. On a purely apples to apples comparison of sites from Static HTML vs CMS does HTML still have an advantage?
Thank you
michael
-
I cant really add to what Egal and Ryan has said. but i sent you a detailed report of some technical issues via your email from your website as my bit to help. Since you are using a cms yo will proably never get rid of them all, but there are some easy ones to fix, broken hyperlinks and generic non relevant link text. Never waste link text.
-
My sort of Music
-
yep...what he said
The most obvious reason for using noodp and noydir is to stop the search engine from using information from those directory listings (which may be out of date), but Google is choosing to return what it thinks" most accurately represent the content on the page these days. Sometimes that might be what you provide in your Titles and tags, sometimes not.
Sha
-
Yep... Just saying what I use... other people will probably want to find their own solution.
I was lucky to get the ClickTracks log file analysis program a long time ago... It was really expensive but has served me well for years.
You can get a wimpy log file analysis program at weblogexpert.com ... I use it for simple reports.
-
I like the idea of ClickTrack but unfortunately the product is no longer offered in a standalone form. It has been integrated into a platform designed to assist with e-mail marketing. The packaging solution is expensive (4 figures) and requires a annual contract.
-
If I can jump in, I would say no damage at all.
noodp and noydir merely tell Google not to use your site's information for title and meta descriptions rather then your DMOZ or Yahoo directory information. This option has less importance nowadays since Google is more aggressively changing those tags on their own.
-
That is a source of the information that I was thinking about.
I use ClickTracks and get a similar report (with a full list of keywords).
-
EGOL,
Would you be referring to Traffic Sources > Keywords report?
For example,September 2011:
Search sent 6,200 total visits via 2,427 keywords
Non-paid keywords: 1,147
Paid: 137
Non-branded, Non-paid keywords: 2,168
*The above is an advanced segment I use.September 2010:
Search sent 7,804 visits via 1,279 keywords.
Non-paid: 1,186
Paid: 3,954
Non-branded, Non-paid keywords: 2,020This seems to reveal that things may not be as dire as I thought.
I did have less PPC spend July-Sept year-over-year. -
Sha,
Thank you for the Screaming Frog tool. It showed that several pages - including the HOMEPAGE - were noodp & noydir - I have no idea how this happened. Nevertheless, they have been resurrected.
How much damage do you think my homepage being set as noodp, noydir has done to my rankings?
-
To assess longtail traffic gain or loss, I simply look at the number of keywords that deliver traffic during Month A and compare that to the number of keywords delivering traffic during Month B.
-
Flawless roundhouse kick good sir.
-
Wow! I'll take that as a compliment
Just don't tell Dr Pete!
Always easier to switch on to something when you see it produce a real result. Glad I could help.
Have a great night,
Sha
-
Thanks for the tip! You convinced me.
I had read Pete's article on the topic but it wasn't enough to motivate me to go and download it. Thanks for sharing.
-
Hey Ryan,
Just using Screaming Frog SEO Spider. It has proven very reliable and quickly identifies errors, server status for every page and much more.
The caveat is that I always check any Status code errors in the browser as there are quite often situations like this where the server is returning a Status error when the page renders fine in the browser.
You just have to be careful to ensure that if you want to scan the root domain you use the non-www URL as usual.
Hope it's useful,
Sha
-
Sha? Do you have a tool which scans all pages on a website looking for redirects? Or are you using a crawler?
-
Hi Carlton,
Awesome answers from everyone here!
I just wanted to add that it appears there is only the one 302 redirect that has been incorrectly placed, but of course it is an important one as 302 redirects do not pass link value, so any external site that happens to have linked to your non-www domain will not be adding value to your link profile.
Also, this page http://www.ietravel.com/central-south-america, although appearing to be fine when viewed in the browser, is returning a 500 Error for crawlers (Internal Server Error). You will need to get your tech people to sort this out for you.
Hope that helps,
Sha
-
how do you so quickly identify the 302 redirect?
There are many tools which can perform this function. Since you are here at SEOmoz it is likely you have the MOZbar installed. Navigate to http://ietravel.com then click the Analyze Page button and select Page Attributes then scroll to the bottom. You will see the 302 header code.
I did not look any further but whomever fixes this issue should not simply resolve this one redirect. They should examine all the redirects to ensure no other 302s are in use.
Do you think I would be better off just deleting these nodes that Drupal generates from the forms?
I would not suggest deleting anything which offered a value to you or your site's visitors. If you know the issue will be resolved in the future, my suggestion would be to leave things as-is and focus your efforts on other areas.
any tips on pulling specific reports/tools to identify where a drop in long-tail has occurred?
I am still searching through SEO tools trying to find the best ones for various tasks. I don't have any suggestions here but hopefully others may share their experiences.
-
Magento,
Thanks for your input. Linkbuilding is one piece of the puzzle I've not had the budget for....Any recommendations for services? You are welcome to PM me offline.
Cheers
-
Hello Ryan. Thanks for participating in helping me figure this out. You are correct - competition in our space has really ramped up in the last year as we fight for the last bit of consumers' disposable income. Also, there has been a steady decline year-over-year in travel-related search terms, according to Google Insights.
RE: the robots.txt. On the form pages - we actually do NOT have a customer log-in area (planned for an upcoming improvement), so that's why I had them blocked by robots - as a safeguard. Do you think I would be better off just deleting these nodes that Drupal generates from the forms? I had been leaving them there because I wanted to have the historic data on hand, but it seems to be doing more harm than good.
Also, how do you so quickly identify the 302 redirect? Our DNS controls are administered by parent company's support, so I'll need some "proof" to get this error corrected.
Finally, any tips on pulling specific reports/tools to identify where a drop in long-tail has occurred?
Thanks again for your insight.
-
Wonderful reply, EGOL. I am very inspired - I hear 'getting stronger' in the background.
Correct you are about the competitiveness of this space - and we have actually recently had a huge competitor enter the space for our Amazon River cruises.) We are challenged with a lean budget, and I am a one-man e-commerce show.
I think you are right - it's time to go back to basics w/ the term-targeting grader. Solid suggestions on the UI as well.
Question: To your analytics point, what is the best way to determine if the long-tail search volume has dropped? I'm trying to think of the best way to pull this in Google Analytics.
Thanks again for your inspirational post and insight.
-
csmith, you just got a great site review and FREE. Egol is right, you are competing with the savages. That's like trying to compete for the word "car insurance" or "real estate". I have a small site which ships cars overseas and I am launching a new campaign to compete in "container shipping". I am in the process of hiring our a couple link builders because I know that's a very competitive field, but not as competitive as yours.
EGOL, I'm going to watch that movie now. I can see the similarity of cannibals. Call it cut throat marketing!
-
lol! I was expecting maybe Survivor - Eye of the Tiger.
-
Listenin' to this right now...
-
What an awesome reply. Mine was rather boring in comparison. I can feel the energy from your reply. It's as if a fast-paced, upbeat song is playing in the background which causes your blood to race.
-
You compete in a very aggressive space with lots of professional muscle. The SEOs in this space are experienced, hungry, savvy and sometimes tricky. The sites that you compete against have enormous development budgets and can toss teams of people into a project. Their authors produce best-on-the-web content with first class authorship, fantastic maps, great photos and more. I could go on and on.
You don't reveal this in your post but my question is.....
What are you doing that will put you on a footing to compete with these cannibals - even in small niches?
SEO in the travel area is a "Battle of Resources".
======================
Some suggestions after a quick look at your site...
-- I think that your on-page optimization needs kicked up a notch. I would read the SEOmoz guide. Run the optimization tool in the rankings checker. The terms that you are gunning for based upon title tags are not even present on some of the pages that I visited. You are competing against the cannibals. Sharpen your knife!
-- What are you putting on this site that will stand apart in your niche and attract links? I see lots of short content with chest thumping. How about some real meat about your destinations? For example, you offer a Galapagos tour but I can't find much about why people would want to visit that destination... What are they going to see... what important things happened there.. why are these islands some of the most unique rocks on this planet.. Walk in the steps of Darwin and share some of his observations... the history of the place, conservation, iguanas, boobies, tortoise, flightless cormorants, tropical penguins., the unique environment... people are fascinated with volcanoes! I hope that your tour guides know about all of this stuff and are ready to sing about it. Convince me that you are the tour company that should take me. I am not convinced that you know what is there. I wanna be sure that I get my money's worth and make good use of my time. I am not convinced that you know enough about this destination to teach me anything. Tell me the story that will get my blood pumping to visit and ready to reach for my wallet!
-- Give people pages that they can link to from their FB wall and say... I AM GOING HERE! WOW! Eat your heart out!
-- What are you doing to make this site exceptionally easy to share via social media? I can't find the buttons... oh... there are a couple darked out ones waaaay down in the bottom of the footer. Nobody is looking down there... put them up high were everyone will see them and get their mouse on them quickly.
-- Don't advertise an empty forum at the top of your site. Get some action in there. Have your guides post some conversation starters. Have them invite questions. Ask a few satisfied travellers to share their experience. Visitors are going to leave if they look in there now.
-- On your chat page get CENTRAL TIME right up there with the times of operation. People don't know if your chat team is in London, Tokyo or Peoria.
-- You say that your traffic is down year-over-year. Have you looked into analytics to see if your rankings have dropped, if your long tail has fallen, where was that lost traffic coming from. Just guessing, I think that you are losing it to competitors in your niche who are aggressively building best-on-the-web content that attracts lots of heavy links and scoops long tail traffic away from other websites. Also, even small websites in your niche are building pages with substantive content that are optimized for specific keywords like finely crafted arrows.
-- Finally, your destinations each had several pages of information and when I clicked from one to another they were slow to load and did not have a consistent look and feel. I recommend a seamless format and am wondering if the big juicy photo at the top is the way to go. They are great photos but they are pushing your content way down and are not consistent from page to page.... I wondered if I was still on the right part of the site.
========================
I know that I poked really hard at you in my reply. But in this niche you got to go for their throats because they are already reaching for yours.
Good luck.
-
Hi Carlton.
Congratulations on the new website. Drupal seems like a solid CMS choice.
My first suggestion is to avoid the use of robots.txt as much as possible. When you installed Drupal there was probably a default robots.txt file as part of the installation. Do everything you can not to add additional entries to the file.
Your site has a specific amount of PR. When you block a page with robots.txt, all the PR on that page is wasted as the page cannot be read by crawlers. A much better option is to add the "noindex" tag to pages you wish to keep out of Google's index. This tag would apply to pages such as the dates-rates page. For the pages with user information, I presume the user had to log in to provide their private information? If so, Google will not crawl any pages behind a login. An exception would be if a URL was provided with the username and password included as parameters in the URL, but that method is very uncommon.
You do want to resolve your duplicate title tags and duplicate meta descriptions.
With respect to your 10-20% traffic drop year over year, there are many potential factors. The world economy is not all that great. Is the travel industry as a whole suffering a drop?
Some other possibilities would be any competitor(s) offering promotions or increasing their SEO efforts, tv ads, magazine ads or any other form of marketing. A new website or company could also be competing for your business.
My overall advise would be to continue to focus on building your website and it's SEO. If you really want to pursue the issue of last year's sales drop further, you would need to thoroughly analyze your Google Analytics data. Look at exactly which pages attracted traffic, from which sources, using which keywords, etc. Perform a similar analysis for this year. Determine exactly where you traffic dropped. You would need to determine if your rankings dropped, or perhaps the traffic on your keywords dropped, etc.
EDIT: I noticed when I tried to visit ietravel.com, the page was 302 directed to www.ietravel.com. I strongly recommend changing the redirect to a 301. 99%+ of the time, a 302 should never be used. Review your site to ensure there are no other 302s in place.
Some other suggestions:
-
add trust symbols to your site. BBB, Verisign, TRUSTe and other symbols have been proven to increase trust and conversion rates.
-
Move your social engagement symbols out of your footer and to a more visible location on your site.
-
review each page of your site, especially the pages 1 click from your home page. I looked at your "about-ie" page and noticed you have an anchor text link "Award-Winning Nature Travel" which is a broken link.
-
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Can you confirm legitimate Google Bot traffic?
We use Cloudflare as a firewall. I noticed a significant number of blocks of bot traffic. One of the things they do is try to block bad bot traffic. But it seems they are mistakenly blocking Google Bot traffic. If you use Cloudflare, you may want to look into this as well. Also, can you confirm if the following IPs are for legitimate Google Bots? 66.249.79.88
Technical SEO | | akin67
66.249.79.65
66.249.79.80 66.249.79.76 Thanks,1 -
Why has my search traffic suddenly tanked?
On 6 June, Google search traffic to my Wordpress travel blog http://www.travelnasia.com tanked completely. There are no warnings or indicators in Webmaster Tools that suggest why this happened. Traffic from search has remained at zero since 6 June and shows no sign of recovering. Two things happened on or around 6 June. (1) I dropped my premium theme which was proving to be not mobile friendly and replaced it with the ColorMag theme which is responsive. (2) I relocated off my previous hosting service which was showing long server lag times to a faster host. Both of these should have improved my search performance, not tanked it. There were some problems with the relocation to the new web host which resulted in a lot of "out of memory" errors on the website for 3-4 days. The allowed memory was simply not enough for the complexity of the site and the volume of traffic. After a few days of trying to resolve these problems, I moved the site to another web host which allows more PHP memory and the site now appears reliably accessible for both desktop and mobile. But my search traffic has not recovered. I am wondering if in all of this I've done something that Google considers to be a cardinal sin and I can't see it. The clues I'm seeing include: Moz Pro was unable to crawl my site last Friday. It seems like every URL it tried to crawl was of the form http://www.travelnasia.com/wp-login.php?action=jetpack-sso&redirect_to=http://www.travelnasia.com/blog/bangkok-skytrain-bts-mrt-lines which resulted in a 500 status error. I don't know why this happened but I have disabled the Jetpack login function completely, just in case it's the problem. GWT tells me that some of my resource files are not accessible by GoogleBot due to my robots.txt file denying access to /wp-content/plugins/. I have removed this restriction after reading the latest advice from Yoast but I still can't get GWT to fetch and render my posts without some resource errors. On 6 June I see in Structured Data of GWT that "items" went from 319 to 1478 and "items with errors" went from 5 to 214. There seems to be a problem with both hatom and hcard microformats but when I look at the source code they seem to be OK. What I can see in GWT is that each hcard has a node called "n [n]" which is empty and Google is generating a warning about this. I see that this is because the author vcard URL class now says "url fn n" but I don't see why it says this or how to fix it. I also don't see that this would cause my search traffic to tank completely. I wonder if anyone can see something I'm missing on the site. Why would Google completely deny search traffic to my site all of a sudden without notifying any kind of penalty? Note that I have NOT changed the content of the site in any significant way. And even if I did, it's unlikely to result in a complete denial of traffic without some kind of warning.
Technical SEO | | Gavin.Atkinson1 -
HUGE decrease in links since website redesign
We recently added several new pages pages to our website. These new pages were constructed on a dev site, and then pushed live. Since the new site has gone live I have seen a huge decline in links. My external followed links have dropped from 3000 to 500 and my total website links have fallen from 35,000 to 4,500. I have done some research, and I think there is a server side issue. Where multiple versions of my URL may be running. The majority of the links built were pointing to the homepage. That being said I do not have access to our in-house dev person this week, so I am trying to identify the problem myself. I have used screaming frog to crawl my site and did not see any errors which stand out. I realize I probably need to use 301 redirects to solve this problem, I just need some guidance on how to identify what I need to 301 redirect. Second question. If I move a landing page out of the global navigation but it can still be reached through other pages on the website , will this cause issues?
Technical SEO | | GladdySEO0 -
Questionable Referral Traffic
Hey SEOMozers, I'm working with a client that has a suspicious traffic pattern going on. In October, a referral domain called profitclicking.com started passing visits to the site. Almost, in parallel the overall visits decreased anywhere from 35 to 50%. After checking out profitclicking.com more, it promises more traffic "with no SEO knowledge". The client doesn't think that this service was signed up for internally. Regardless, it obviously smells pretty fishy, and I'm searching for a way I can disallow traffic from this site. Could I simply just write a simple disallow statement in the robots.txt and be done with it? Just wanted to see if anyone else had any other ideas before recommending a solution. Thanks!
Technical SEO | | kylehungate0 -
Received Google Webmaster Tools notice of detected unnatural links , but no negative impact on ranking and traffic, What should i do next?
Hello, On May 19 , 2012 Google webmaster sent notification "Google Webmaster Tools notice of detected unnatural links to " both sites haven't lost any ranking or traffic as yet. I am worried, Should i panic,what should i be doing , will it be going down anytime soon? how to naturally build links?
Technical SEO | | conversiontactics0 -
Site Structure Still Old
Ok after my first SEO report from seomoz I re-structured one of my sites. I basically split it into two different sites. I did this way before it was re-crawled on 5/1 and the results still show pages that no longer exist on that domain. What is causing this (user error I am sure but I just need to know what I can do to fix it).
Technical SEO | | bobbabuoy0 -
Hyperlinks under description in organic listings ...
If you search on Google for yosemite rentals the first organic result that shows up is www.redwoodsinyosemite.com. How are they able to get the links under description: Agent Login - Our Gallery etc ..
Technical SEO | | afranklin0 -
Multiple Domains, Same IP address, redirecting to preferred domain (301) -site is still indexed under wrong domains
Due to acquisitions over time and the merging of many microsites into one major site, we currently have 20+ TLD's pointing to the same IP address as our "preferred domain:" for our consolidated website http://goo.gl/gH33w. They are all set up as 301 redirects on apache - including both the www and non www versions. When we launched this consolidated website, (April 2010) we accidentally left the settings of our site open to accept any of our domains on the same IP. This was later fixed but unfortunately Google indexed our site under multiple of these URL's (ignoring the redirects) using the same content from our main website but swapping out the domain. We added some additional redirects on apache to redirect these individual pages pages indexed under the wrong domain to the same page under our main domain http://goo.gl/gH33w. This seemed to help resolve the issue and moved hundreds of pages off the index. However, in December of 2010 we made significant changes in our external dns for our ip addresses and now since December, we see pages indexed under these redirecting domains on the rise again. If you do a search query of : site:laboratoryid.com you will see a few hundred examples of pages indexed under the wrong domain. When you click on the link, it does redirect to the same page but under the preferred domain. So the redirect is working and has been confirmed as 301. But for some reason Google continues to crawl our site and index under this incorrect domains. Why is this? Is there a setting we are missing? These domain level and page level redirects should be decreasing the pages being indexed under the wrong domain but it appears it is doing the reverse. All of these old domains currently point to our production IP address where are preferred domain is also pointing. Could this be the issue? None of the pages indexed today are from the old version of these sites. They only seem to be the new content from the new site but not under the preferred domain. Any insight would be much appreciated because we have tried many things without success to get this resolved.
Technical SEO | | sboelter0