Having possible problems with rankings due to development website
-
Hi all,
I've got an interesting issue and a bit of a technical challenge for you.
It's a bit complicated to explain, but please bear with me.
We have a client website (http://clientwebsite.com) which we are having a hard time ranking in the past few months. Main keywords simply don't show up in Top100 searches, even though we are constantly building backlinks through Guest Posts, Citations, Media mentions, Profile links etc.
Normally, we use ahrefs to look at the client's website backlinks, but just today we used Majestic to look at the backlink profile and one backlink stood out.
This is a backlink from a development server (http://developmentwebsite.com) which redirects to http://clientwebsite.com
The developers who were working on the redesign of the client website, put it up on their server and forgot to delete it.
Also, the content inside the development website is almost identical with the client website.We then checked to see if http://developmentwebsite.com is indexed.
It's not.Although, inside the robots file http://developmentwebsite.com/robots.txt there's:
User-agent: *
Allow: /
The funny (and weird thing) is that http://developmentwebsite.com/ and all development website inner pages are not indexed in Google.But if we go to http://developmentwebsite.com/inner-page, it doesn't redirect to the corresponding http://clientwebsite.com/inner-page, it's the same development website page URL and the pages even have links to the client website, but like I said, none of the pages of the development website are indexed, even though crawlers are allowed in the robots.txt's development website.
In your opinion, could this be the reason why we are having a hard time to rank the client website?
Second question is:
How do we approach in solving this issue?
Do we simply delete the whole http://developmentwebsite.com with all the inner pages?
Or should we do 301 redirrects on a per-page basis? -
the problem, might be about your template .
-
Thank you Jake, will definitely give this some thought.... Appreciate the help.
-
Recommending link development would be difficult without knowing more about your specific industry, competitive advantages, etc.
Generally speaking, you want to focus first on ensuring you have valuable assets capable of justifying new links to your site. This would be a variety of content types depending upon your business, but can range from Free Advice and How To Guides, Data Insights, Tools/Widgets, Detailed comparison/reviews, Interviews and insights from industry through leaders, etc. You can use methods like broken link building to identify new content opportunities that you can capitalize upon, or look at top linked pages on competitor sites to see the types of content that has earned their links.
Once you have established your linkable assets, you can begin the process of outreach and amplification to bring attention to those assets and earn natural links. Of course, you can always reach out to other thought leaders, cited sources, etc... to encourage some additional sharing, linking, etc.
You can also do link profile comparisons to see if there are reputable outlets citing your competitors but not mentioning you.
Those are just a few examples off the top of my head. If you have the resources to do link dev internally and just need strategy guidance, you should check out the Moz recommended list, as many of those agencies (I know ours does) will offer ad-hoc consultation to help your team get the systems in place to be successful with your link dev efforts.
Cheers,
Jake
-
Thanks, Jake. We've had the dev site removed.
As a side note, what link-building would you recommend if you think we should not be doing outreach / guest posting?
Cheers!
-
You have to search and replace the new sites URLs with the same consistent URL not from the dev server then block the dev server.
- search and replace the URLs in the new site.
- block the developer site with a password
First things first take Make sure you have all the images and code on the http://clientwebsite.com/
Then go to the new site and do a search and replace on all the URLs including the database.
Search for http://developmentwebsite.com & replace with http://clientwebsite.com
- https://www.funduc.com/search_replace.htm
- https://interconnectit.com/products/search-and-replace-for-wordpress-databases/
After doing this.
Go on to the development site and block URLs by password-protecting your server directories
Place a password on the site preventing it from being indexed by anything or even accessed without using the password.
- https://support.google.com/webmasters/answer/93708
- https://blogvault.net/how-to-block-google-from-indexing-your-wordpress-site/
You might want to check the header tags in the development site URLs. This would only be for curiosity you really want these things gone.
Did you check for
_(…)_ **X-Robots-Tag: noindex** _(…)_
Or no index meta tag in the section of your page:
Lastly, remove the offending URL's from Google if you must & follow this guide when launching sites.
I hope this helps,
Tom
-
You can also use Moz's Open Site Explorer to look at the spam scores of your incoming links.
-
Zakkyg, as previously mentioned, the problem may be the "building backlinks through Guest Posts and Profile links, and the type of links that you're building to the site. I would take one step further and run the site's links through Link Research Tools' Link Detox to make sure that the links to the site are good links and you're not building any toxic links.
I would also immediately take down the development site completely. Make it deliver 404 error pages, with all URLs. There's no need to set up redirects at all. Since it is an old dev site, it really shouldn't have any traffic or links to it--so I would just remove it.
-
Great question..
First... some of your rankings problem may be around this - "Guest Posts, Citations, Media mentions, Profile links etc."... at least 2 of those items carries some decent risk, the consequences of which would be "not ranking". Have you checked search console to see if any manual actions exist? Did you have rankings and they disappeared, or have you been unable to secure rankings in general? Does the site currently get organic traffic, but just maybe on terms that you aren't targeting?
As far as the development site, this could easily be a separate issue from your rankings, and I would doubt this would cause significant rankings drops if the dev site isn't being indexed by Google. Would you be lucky enough to have any type of access to this through a CMS login? If so, you could easily verify the site in search console and see where things stand in terms of indexing. Additionally, if you could access through the CMS, you might be able to change a few settings, such as canonical tags, "website" or discourage indexing (if wordpress), etc. .that would cause the site to begin redirecting to your clientwebsite.com or at least give the indication that it is a known copy.. Did you check the individual pages of the site to see if a meta tag is in place on the pages blocking robots?
Ultimately the easiest thing regarding the dev site would be to simply ask the dev company to remove the site...
Cheers,
Jake
-
I would do the redirect to be safe then in the future make sure you run noindex on any development sites.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
New Website SEO Implications
Hi Moz Community, A client of mine has launched a new website. The new website is well designed, mobile friendly, fast loading and offers a far better UX than the old site. It has similar content but 'less wordy'. The old website was tired, slow, not mobile responsive etc but still ranked well. The domain has marketing leading authority and link metrics. Since the launch, the rankings for virtually every word has plummeted. Even previously ranked #1 words have disappeared to page 3 or 4. New pages have different URLs (301s from the old urls are working fine) and still score the same 98% (using the Moz page optimiser tool). Is it usual to experience some short term pain, or are these rankings drop an indication that something else is missing? My theory is that the new URLs are being treated like new pages, and that those new pages don't have the engagement data which is used for ranking. Thus, despite having the same authority of the old pages, as far as user data is concerned, they are new pages and therefor, not ranking well - yet. That theory would make logical sense but I'm hoping some experts here can help. Any suggestions welcome. Here's a quick checklist of things I have already done: complete 301 redirect list
Intermediate & Advanced SEO | | I.AM.Strategist
New sitemap
Submitted to console
Created internal links from within their large blog
Optimised all the new pages (img alts, H1s etc) Extra info: Platform changed from Wordpress to Expression engine
Target pages now on level 3 not level 2 (extra subfolder used)
Less words used (average word count per page from 400+ to 250) Thanks in advance 🙂0 -
Interested ranking results
Hello, I have different pages that are written on the same model. I updated their content 2 weeks ago. Some of those climbed to 1 st page or beginning or 2 nd some didn't move or stayed where they originally were, 3 rd of 4 th page ? My question is whether there is a longer delay for some of them to rank (due to the term being more competitive for example) or if I should look somewhere else in maybe something that I wrote in the content of the pages that ranked versus those than didn't move. Thank you,
Intermediate & Advanced SEO | | seoanalytics0 -
Our website is not being indexed
We have an issue with a site that we can't get to the bottom of. This site: (URL removed) is not being properly indexed. When we do a search for (URL removed) in google.com.au. The site appears as the 4th listing with the following title and description: (Title removed) A description for this result is not available because of this site's robots.txt – learn more. We have checked the site's robots.txt and can see its been now implemented correctly: (URL removed) About a week ago, we also went into Webmaster Tools and submitted a request for Google to recrawl our site. We are unsure what the issue is that is causing the site to not be properly indexed and how to resolve it. Any assistance on this topic would be most appreciated!
Intermediate & Advanced SEO | | Gavo0 -
I want my website to rank on the first page for a very competitive keyword
I am a WordPress designer and can service national clients. I want to rank on the first page for the keyword WordPress designer. This is a highly competitive keyword MOZ gives it a 68% difficulty. I rank locally in nj for WordPress designer nj and a multitude of local WordPress based key words. I rank on page 10 of serps doing a private browsing session. Some of my national competitors rank on the first page with not many links in. How could i be so low on the serps for the base keyword WordPress Designer but for local WordPress designer nj be number 1 everytime? What should be my best plan of attack if i want to Rank much higher for this one specific keyword hopefully page 1. I think this one keyword could increase business greatly so it is a top priority for me. I appreciate all advice 🙂
Intermediate & Advanced SEO | | donsilvernail0 -
Is it possible to rank a RE-DIRECT in Google ?
Hi Guys Some help here please would be much appreciated. I have created a super URL re-direct to my Amazon product page. So my question is If I spend time and money build SEO links to my re-direct URL will it still rank high in Google or does Google NOT like or rank re-direct URLs ??? Thanks Gareth
Intermediate & Advanced SEO | | GAZ090 -
Problem with internal links
Hello! Our domain, http://www.unionroom.com/, is having a strange issue with OSE in that it is telling us our internal pages aren't linking to one another. An example of this is that it is showing our About page ( http://www.unionroom.com/about/ ) only having three links, but this link appears twice on every single page on the website (~200 pages) in the header and footer. We've hung around for a little while to see if OSE would correct itself, but it hasn't and this now suggests that it may be an issue with our in-linking structure. Can anyone spot any issues with our build? The rest of the websites that we produce, that are all built in the same way, all have healthy internal linking structures according to OSE. Very confusing! Any help would be greatly appreciated.
Intermediate & Advanced SEO | | unionroom0 -
Is it possible we are being penalized for doorway pages?
www.trophycentral.comHi, we were hit very hard a few years ago by Panda and have been try to recover. We completely revamped our site (structure, canonical, duplicates, content, etc.) and had a couple of keywords recover. However, most traffic has not comeback and still cannot be found in the top 30 pages or so for major phrases. We have compared ourselves to major competitors in our industry and see very few differences. The only thing I see as a difference is that many of our products are in multiple sections. For example, we have all baseball awards (trophies, pins, medals) grouped together. We then have just baseball medals together and just baseball pins together. Is this something that could be causing us not to rank? I am asking because the phrases that are ranking are the ones that don't have multiple categories. We have no manual penalties, but now I am thinking this is what Google might consider a doorway page?As an experiment, I just noindexed all but one category for baseball and soccer to see what happens.Does this make sense? Has anyone else seen this?Thanks!
Intermediate & Advanced SEO | | trophycentraltrophiesandawards0 -
Why is this site not ranking?
http://www.petstoreunlimited.com They get good grades from the on-page tool. The links are not amazing, but are not super spammy. Yet it ranks for nothing they target Any reason why?
Intermediate & Advanced SEO | | Atomicx0