Having possible problems with rankings due to development website
-
Hi all,
I've got an interesting issue and a bit of a technical challenge for you.
It's a bit complicated to explain, but please bear with me.
We have a client website (http://clientwebsite.com) which we are having a hard time ranking in the past few months. Main keywords simply don't show up in Top100 searches, even though we are constantly building backlinks through Guest Posts, Citations, Media mentions, Profile links etc.
Normally, we use ahrefs to look at the client's website backlinks, but just today we used Majestic to look at the backlink profile and one backlink stood out.
This is a backlink from a development server (http://developmentwebsite.com) which redirects to http://clientwebsite.com
The developers who were working on the redesign of the client website, put it up on their server and forgot to delete it.
Also, the content inside the development website is almost identical with the client website.We then checked to see if http://developmentwebsite.com is indexed.
It's not.Although, inside the robots file http://developmentwebsite.com/robots.txt there's:
User-agent: *
Allow: /
The funny (and weird thing) is that http://developmentwebsite.com/ and all development website inner pages are not indexed in Google.But if we go to http://developmentwebsite.com/inner-page, it doesn't redirect to the corresponding http://clientwebsite.com/inner-page, it's the same development website page URL and the pages even have links to the client website, but like I said, none of the pages of the development website are indexed, even though crawlers are allowed in the robots.txt's development website.
In your opinion, could this be the reason why we are having a hard time to rank the client website?
Second question is:
How do we approach in solving this issue?
Do we simply delete the whole http://developmentwebsite.com with all the inner pages?
Or should we do 301 redirrects on a per-page basis? -
the problem, might be about your template .
-
Thank you Jake, will definitely give this some thought.... Appreciate the help.
-
Recommending link development would be difficult without knowing more about your specific industry, competitive advantages, etc.
Generally speaking, you want to focus first on ensuring you have valuable assets capable of justifying new links to your site. This would be a variety of content types depending upon your business, but can range from Free Advice and How To Guides, Data Insights, Tools/Widgets, Detailed comparison/reviews, Interviews and insights from industry through leaders, etc. You can use methods like broken link building to identify new content opportunities that you can capitalize upon, or look at top linked pages on competitor sites to see the types of content that has earned their links.
Once you have established your linkable assets, you can begin the process of outreach and amplification to bring attention to those assets and earn natural links. Of course, you can always reach out to other thought leaders, cited sources, etc... to encourage some additional sharing, linking, etc.
You can also do link profile comparisons to see if there are reputable outlets citing your competitors but not mentioning you.
Those are just a few examples off the top of my head. If you have the resources to do link dev internally and just need strategy guidance, you should check out the Moz recommended list, as many of those agencies (I know ours does) will offer ad-hoc consultation to help your team get the systems in place to be successful with your link dev efforts.
Cheers,
Jake
-
Thanks, Jake. We've had the dev site removed.
As a side note, what link-building would you recommend if you think we should not be doing outreach / guest posting?
Cheers!
-
You have to search and replace the new sites URLs with the same consistent URL not from the dev server then block the dev server.
- search and replace the URLs in the new site.
- block the developer site with a password
First things first take Make sure you have all the images and code on the http://clientwebsite.com/
Then go to the new site and do a search and replace on all the URLs including the database.
Search for http://developmentwebsite.com & replace with http://clientwebsite.com
- https://www.funduc.com/search_replace.htm
- https://interconnectit.com/products/search-and-replace-for-wordpress-databases/
After doing this.
Go on to the development site and block URLs by password-protecting your server directories
Place a password on the site preventing it from being indexed by anything or even accessed without using the password.
- https://support.google.com/webmasters/answer/93708
- https://blogvault.net/how-to-block-google-from-indexing-your-wordpress-site/
You might want to check the header tags in the development site URLs. This would only be for curiosity you really want these things gone.
Did you check for
_(…)_ **X-Robots-Tag: noindex** _(…)_
Or no index meta tag in the section of your page:
Lastly, remove the offending URL's from Google if you must & follow this guide when launching sites.
I hope this helps,
Tom
-
You can also use Moz's Open Site Explorer to look at the spam scores of your incoming links.
-
Zakkyg, as previously mentioned, the problem may be the "building backlinks through Guest Posts and Profile links, and the type of links that you're building to the site. I would take one step further and run the site's links through Link Research Tools' Link Detox to make sure that the links to the site are good links and you're not building any toxic links.
I would also immediately take down the development site completely. Make it deliver 404 error pages, with all URLs. There's no need to set up redirects at all. Since it is an old dev site, it really shouldn't have any traffic or links to it--so I would just remove it.
-
Great question..
First... some of your rankings problem may be around this - "Guest Posts, Citations, Media mentions, Profile links etc."... at least 2 of those items carries some decent risk, the consequences of which would be "not ranking". Have you checked search console to see if any manual actions exist? Did you have rankings and they disappeared, or have you been unable to secure rankings in general? Does the site currently get organic traffic, but just maybe on terms that you aren't targeting?
As far as the development site, this could easily be a separate issue from your rankings, and I would doubt this would cause significant rankings drops if the dev site isn't being indexed by Google. Would you be lucky enough to have any type of access to this through a CMS login? If so, you could easily verify the site in search console and see where things stand in terms of indexing. Additionally, if you could access through the CMS, you might be able to change a few settings, such as canonical tags, "website" or discourage indexing (if wordpress), etc. .that would cause the site to begin redirecting to your clientwebsite.com or at least give the indication that it is a known copy.. Did you check the individual pages of the site to see if a meta tag is in place on the pages blocking robots?
Ultimately the easiest thing regarding the dev site would be to simply ask the dev company to remove the site...
Cheers,
Jake
-
I would do the redirect to be safe then in the future make sure you run noindex on any development sites.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moving my website to Wordpress, what are the possible consequences?
I am moving my website to WordPress after years. I am curious to know what the best route to maintain as much SEO value as possible would be. We have a lot of 301 redirects currently, and we will maintain those, but what else should we do or know? Thanks for any help.
Intermediate & Advanced SEO | | hwade0 -
Silly Question still - Because I am paying high to google adwords is it possible google can't rank me high in organic?
Hello All, My ecommerce site gone in penalty more than 3 years before and within 3 months I got message from google penalty removed. Since then till date my organic ranking is very worst. In this 3 years I improved my site onpage very great. If I compare my site with all other competitors who are ranking in top 10 then my onpage that includes all schema, reviews, sitemap, header tags, meta's etc, social media, site structure, most imp speed, google page speed insight score, pingdom, w3c errors, alexa rank, global rank, UI, offers, design, content, code to text raito, engagement rate, page views, time on site etc all my sites always good compare to competitors. They also have few backlinks I do have few backlinks only. I am doing very high google adwords and my conversion rate is very very good. But do you think because I am paying since last 3 year high to google because of that google have some setting or strategy that those who perform well in adwords so not to bring up in organic? Is it possible I can talk with google on this? If yes then what will be the medium of conversation? Pls give some valuable inputs I am performing very much in paid so user end site is very very well. Thanks!
Intermediate & Advanced SEO | | pragnesh96390 -
Website Not Ranking Organically - Not Links, Not Domain Authority...
This is regarding the domain: http://lesliekays.com We got a new client about 5 months back who had a website that was hacked. It took several months, but we've cleaned up most of the spammy links and completely rebuilt their website. We have been successful with every other client that we have ever done getting our customers to rank well organically, but we just can't figure this one out. I'm willing to offer a REWARD to the single person who can figure this out for us. (Let's not get carried away, a small reward). This customer has great quality links to their site too. We are looking for answers other than: 1. Backlinks 2. Content 3. Malware 4. Domain or Page authority 5. 404 errors 6. We have utilized Googles Webmaster tools endlessly It is something else and we can not identify it! Let me know what you think! I will give a public shout out to the person who helps us identify this issue!
Intermediate & Advanced SEO | | Tosten0 -
Is my website is having enough content on it to rank?
I have less content on my website, is this okay or I need to add more content on my pages? Website is - brandstenmedia.com.au Any other suggestions for the website?
Intermediate & Advanced SEO | | Green.landon0 -
Whats up with this website?
cybercig.co.uk Languishing around 150-200 in the rankings, very barely making it above 70. But also ranks for Refillable Electronic Cigarette on the first page. Any ideas whats happening? Not a huge amount of links but I'd have thought it would've been much higher. I'd love to know opinions 🙂
Intermediate & Advanced SEO | | jasondexter0 -
Created the content, yet we don't rank for it. Toxic website?
Hey everyone, I'm beginning to think our site is toxic i.e. it'll never rank properly again irrespective of what we do. I recently published some data (2 months ago) in an interactive visual called the "iPhone 5S Price Index". I outreached and got thousands of links from sites including Forbes, Gizmodo (various international versions), Washington Post, The Guardian, NY Times, etc etc. All of these results dominate the Google rankings, all with links pointing to us. YET, we're no where to be seen. What incentive are Google giving content creators, like me, to continue producing content that is obviously popular if we can't even rank for it? The traffic we received was fantastic. In one day the traffic was 40 times our average, which made me smile like a Cheshire Cat from ear-to-ear but we need to improve our rankings overall otherwise the value to us is lost. The traffic wasn't there to buy our service, they were there to see the graphic. Hopefully our brand exposure leads to future sales, but it's a pittance compared to our previous rankings income. I've had this type of success 3 times in the last few months on this site alone. Yet nothing changes. We suffered from a loss of rankings in September 2012, fighting ever since to get it back. Now I'm losing hope it is even possible. Does anyone know why our site wouldn't rank when we're undeniable the source that created the work? Also, why wouldn't the increase in domain authority (which has jumped about 10 points according to OSE) have a knock on effect for the rest of our keywords - or even let us appear within the top 100 for ones we obviously serve? We do Real Company Shit - and we're good at it. But I need these rankings back. It's driving me nuts. Thanks.
Intermediate & Advanced SEO | | purpleindigo0 -
301 Redirection problems
A couple of days ago we did a restructure of our e-commerce site (wordpress + woocomerce) where some product categories needed to change names. I used Yoast SEO plugin to do 301 redirects in the .htaccess file.Today I noticed that we had two hits in the SERP on the phrase "dildos med vibrator". See the attached screenshot (first two results).One goes to http://www.oliverocheva.se/kategori/sexleksaker/dildos/dildos-med-vibrator/ which is the right URL. One goes to http://www.oliverocheva.se/kategori/sexleksaker/dildosdildos-med-vibrator-dildos-for-honom/ which is a corrupt URL that has never been in use. The old one we did a redirect from was /kategori/for-honom/dildos-for-honom/dildos-med-vibrator-dildos-for-honom/The command in the .htaccess file was: Redirect 301 /kategori/for-honom/dildos-for-honom/dildos-med-vibrator-dildos-for-honom/ http://www.oliverocheva.se/kategori/sexleksaker/dildos/dildos-med-vibratorWhat has happened here? Why does the 301 create entirely new URL:s in the SERP?Tz0TULT.png
Intermediate & Advanced SEO | | kisen0 -
Rankings going down down down
Hi guys, I know this is a little open ended, but any advice/ideas would be greatly appreciated. I launched a new site about 3 months ago (www.transfersandshuttles.co.za). I have had unique, useful articles written for it, and the site does provide a useful service. I have done a little link building and continue to do so. The site was making decent progress moving up the rankings for a few weeks, but now it just seems to get worse and worse.
Intermediate & Advanced SEO | | cashchampion
I'm not looking for an entire site audit or strategy here, just if anything jumps out at you that seems very poor for seo, please let me know. Thanks so much,
Marc0