Having possible problems with rankings due to development website
-
Hi all,
I've got an interesting issue and a bit of a technical challenge for you.
It's a bit complicated to explain, but please bear with me.
We have a client website (http://clientwebsite.com) which we are having a hard time ranking in the past few months. Main keywords simply don't show up in Top100 searches, even though we are constantly building backlinks through Guest Posts, Citations, Media mentions, Profile links etc.
Normally, we use ahrefs to look at the client's website backlinks, but just today we used Majestic to look at the backlink profile and one backlink stood out.
This is a backlink from a development server (http://developmentwebsite.com) which redirects to http://clientwebsite.com
The developers who were working on the redesign of the client website, put it up on their server and forgot to delete it.
Also, the content inside the development website is almost identical with the client website.We then checked to see if http://developmentwebsite.com is indexed.
It's not.Although, inside the robots file http://developmentwebsite.com/robots.txt there's:
User-agent: *
Allow: /
The funny (and weird thing) is that http://developmentwebsite.com/ and all development website inner pages are not indexed in Google.But if we go to http://developmentwebsite.com/inner-page, it doesn't redirect to the corresponding http://clientwebsite.com/inner-page, it's the same development website page URL and the pages even have links to the client website, but like I said, none of the pages of the development website are indexed, even though crawlers are allowed in the robots.txt's development website.
In your opinion, could this be the reason why we are having a hard time to rank the client website?
Second question is:
How do we approach in solving this issue?
Do we simply delete the whole http://developmentwebsite.com with all the inner pages?
Or should we do 301 redirrects on a per-page basis? -
the problem, might be about your template .
-
Thank you Jake, will definitely give this some thought.... Appreciate the help.
-
Recommending link development would be difficult without knowing more about your specific industry, competitive advantages, etc.
Generally speaking, you want to focus first on ensuring you have valuable assets capable of justifying new links to your site. This would be a variety of content types depending upon your business, but can range from Free Advice and How To Guides, Data Insights, Tools/Widgets, Detailed comparison/reviews, Interviews and insights from industry through leaders, etc. You can use methods like broken link building to identify new content opportunities that you can capitalize upon, or look at top linked pages on competitor sites to see the types of content that has earned their links.
Once you have established your linkable assets, you can begin the process of outreach and amplification to bring attention to those assets and earn natural links. Of course, you can always reach out to other thought leaders, cited sources, etc... to encourage some additional sharing, linking, etc.
You can also do link profile comparisons to see if there are reputable outlets citing your competitors but not mentioning you.
Those are just a few examples off the top of my head. If you have the resources to do link dev internally and just need strategy guidance, you should check out the Moz recommended list, as many of those agencies (I know ours does) will offer ad-hoc consultation to help your team get the systems in place to be successful with your link dev efforts.
Cheers,
Jake
-
Thanks, Jake. We've had the dev site removed.
As a side note, what link-building would you recommend if you think we should not be doing outreach / guest posting?
Cheers!
-
You have to search and replace the new sites URLs with the same consistent URL not from the dev server then block the dev server.
- search and replace the URLs in the new site.
- block the developer site with a password
First things first take Make sure you have all the images and code on the http://clientwebsite.com/
Then go to the new site and do a search and replace on all the URLs including the database.
Search for http://developmentwebsite.com & replace with http://clientwebsite.com
- https://www.funduc.com/search_replace.htm
- https://interconnectit.com/products/search-and-replace-for-wordpress-databases/
After doing this.
Go on to the development site and block URLs by password-protecting your server directories
Place a password on the site preventing it from being indexed by anything or even accessed without using the password.
- https://support.google.com/webmasters/answer/93708
- https://blogvault.net/how-to-block-google-from-indexing-your-wordpress-site/
You might want to check the header tags in the development site URLs. This would only be for curiosity you really want these things gone.
Did you check for
_(…)_ **X-Robots-Tag: noindex** _(…)_
Or no index meta tag in the section of your page:
Lastly, remove the offending URL's from Google if you must & follow this guide when launching sites.
I hope this helps,
Tom
-
You can also use Moz's Open Site Explorer to look at the spam scores of your incoming links.
-
Zakkyg, as previously mentioned, the problem may be the "building backlinks through Guest Posts and Profile links, and the type of links that you're building to the site. I would take one step further and run the site's links through Link Research Tools' Link Detox to make sure that the links to the site are good links and you're not building any toxic links.
I would also immediately take down the development site completely. Make it deliver 404 error pages, with all URLs. There's no need to set up redirects at all. Since it is an old dev site, it really shouldn't have any traffic or links to it--so I would just remove it.
-
Great question..
First... some of your rankings problem may be around this - "Guest Posts, Citations, Media mentions, Profile links etc."... at least 2 of those items carries some decent risk, the consequences of which would be "not ranking". Have you checked search console to see if any manual actions exist? Did you have rankings and they disappeared, or have you been unable to secure rankings in general? Does the site currently get organic traffic, but just maybe on terms that you aren't targeting?
As far as the development site, this could easily be a separate issue from your rankings, and I would doubt this would cause significant rankings drops if the dev site isn't being indexed by Google. Would you be lucky enough to have any type of access to this through a CMS login? If so, you could easily verify the site in search console and see where things stand in terms of indexing. Additionally, if you could access through the CMS, you might be able to change a few settings, such as canonical tags, "website" or discourage indexing (if wordpress), etc. .that would cause the site to begin redirecting to your clientwebsite.com or at least give the indication that it is a known copy.. Did you check the individual pages of the site to see if a meta tag is in place on the pages blocking robots?
Ultimately the easiest thing regarding the dev site would be to simply ask the dev company to remove the site...
Cheers,
Jake
-
I would do the redirect to be safe then in the future make sure you run noindex on any development sites.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why has my website been removed from Bing?
I have a website that has recently been removed from Bing's index, but can't figure out why. The website isn't new, and it is indexed just fine on Google. These are the steps I've tried: The website is verified in Bing Webmaster Tools and successfully submitted the sitemap. I tested the URL to ensure that Bingbot is allowed to crawl the site I submitted URLs to Bing via the URL Submission tool There isn't a "noindex" on the site preventing it from being indexed When I do a URL Inspection, an error message comes up saying "The inspected URL is known to Bing but has some issues which are preventing us from serving it to our users. We recommend you to follow Bing Webmaster Guidelines." I contacted Bing to ask whether the website was removed in error, but received a reply that the website doesn't comply with Bing's quality guidelines, but they wouldn't go into detail as to which guidelines the website isn't meeting. The website URL is https://www.pardeehospital.org. Can anyone offer any advice or insight as to why Bing won't index our site? Thank you!
Intermediate & Advanced SEO | | lindsey.steinkamp0 -
Having issues crawling a website
We looked to use the Screaming Frog Tool to crawl this website and get a list of all meta-titles from the site, however, it only resulted with the one result - the homepage. We then sought to obtain a list of the URLs of the site by creating a sitemap using https://www.xml-sitemaps.com/. Once again however, we just go the one result - the homepage. There is something that seems to be restricting these tools from crawling all pages. If you anyone can shed some light as to what this could be, we'd be most appreciative.
Intermediate & Advanced SEO | | Gavo0 -
Is it possible to find out where traffic is comming from on someone elses website?
Is it possible to find out where traffic is coming from on someone else website? I want to know where the new buyers are coming from who are interested in outsourcing. Attached are some of the pages they would be looking at. Who are visiting these pages and where are they coming from: https://www.upwork.com/blog/ https://www.upwork.com/hiring/ https://www.upwork.com/i/howitworks/client/ https://www.upwork.com/signup/create-account/client_direct https://www.upwork.com/o/profiles/browse/ https://www.upwork.com/press/ https://www.freelancer.com/ https://www.freelancer.com/about https://www.freelancer.com/info/how-it-works.php https://www.freelancer.com/showcase https://www.freelancer.com/community https://www.freelancer.com/hire/ https://www.freelancer.com/contest/ https://www.freelancer.com/feesandcharges/ https://www.freelancer.com/freelancers/ http://www.guru.com/ http://www.guru.com/howitworks.aspx http://www.guru.com/about/ http://www.guru.com/help/ http://www.guru.com/blog/ http://www.guru.com/blog/category/hiring-advice/ http://www.guru.com/d/freelancers/ http://www.guru.com/directory http://www.guru.com/answers/
Intermediate & Advanced SEO | | Hall.Michael0 -
Why my website disappears for the keywords ranked, then reappears and so on?
Hello to everyone. In the last 2 weeks my website emorroidi.imieirimedinaturali.it has a strange behavior in SERP: it disappears for the keywords ranked and then reappears, and so on. Here's the chronicle of the last days: 12/6: message in GWT: Improvement of the visibility of the website in search. 12/6 the website disappears for all the keywords ranked 16/6 the website reappears for all the keywords ranked with some keywords higher in ranking 18/6 the website disappears for all the keywords ranked 22/6 the website reappears for all the keywords ranked 24/6 the website disappears for all the keywords ranked... I can't explain this situation. Could it be a penalty? What Kind? Thank you.
Intermediate & Advanced SEO | | emarketer0 -
No Google Ranking..yet
I have een working on my site for soem time. Trying to take the right steps to achieve good ranking in the long run and present the information we need to showcase to prospective clients. After several months I still see no ranking at all and I'm wondering if its becasue the front page is using a design similar to a one page website design? If anyone can provide some insight I would appreciate it. Even the smallest nudge i nthe right direction. We are also developing some new content for a blog and expanded written content for our services page. http://thatworksdesign.com
Intermediate & Advanced SEO | | Bvrettski0 -
How to rank for difficult terms
I am helping launch a new business venture that sells oak furniture in the UK. The key product terms are along the lines of; oak bed
Intermediate & Advanced SEO | | pretige12
oak dining table
oak chairs etc which are very popular search terms. Im used to being able to hang of local or branded search which arent available in this project. The domain is around 12 months old, it has few inbound links which we are working on now with an overseas freelancer (keeping an eye on them). The pages of the site are unique-content rich and the titles and other meta boxes are ticked. What else would the experts recommend?0 -
Website layout for a new website [Over 50 Pages & targeting Long Tail Keywords]
Hey everyone, We are designing a new website with over 50 pages and I have a question regarding the layout. Should I target my long tail keywords via blog pages? It will be easier to manage and list and link out to similar articles related to my long tail keywords using a word press blog. For this example - lets suppose the website is www.orange.com and we sells 'Oranges' Am I going about this in the right way? Main Section: Main Section 1 : Home Page - Keyword Targeted - Orange Main Section 2 : Important Conversion page - 'Buy oranges' Long Tail Keyword (LTK) 1: www.orange.com/blog/LTK1 Subsection(SS): www.orange.com/blog/LTK1/SS1 www.orange.com/blog/LTK1/SS1a www.orange.com/blog/LTK1/SS1b Long Tail Keyword (LTK) 2: www.orange.com/blog/LTK2 Long Tail Keyword (LTK) 3: www.orange.com/blog/LTK3 Subsection(SS): www.orange.com/blog/LTK1/SS3 www.orange.com/blog/LTK1/SS3a www.orange.com/blog/LTK1/SS3b All these long tail pages and sub sections under them are built specifically for hosting content that targets these specific long tail keywords. Most of my traffic will come initially via the sub section pages - and it is important for me to rank well for these terms initially. _E.g. if someone searches for the keyword 'SS3b' on Google - my corresponding page www.orange.com/blog/LTK1/SS3b should rank well on the results page. _ For ranking purposes - will using this blog/category structure hurt or benefit me? Instead do you think I should build static pages? Also, we are targeting more than 50 long tail keywords - and building quality content for each of these keywords - and I assume that we will be doing this continuously. So in the long term term which is more beneficial? Do you have any suggestions on if I am going about this the right way? Apologies for using these random terms - oranges, LKT, SS etc in this example. However, I hope that the question is clear. Looking forward to some interesting answers on this! Please feel free to share your thoughts.. Thank you! Natasha
Intermediate & Advanced SEO | | Natashadogres0 -
Shall I fix "most Common Errors" for a website that ranked top 3 on Google (difficult KW)?
How can SEOmoz "most Common Errors*" under "Crawl Diagnostics" advice can be right for a good site organic? Site is well ranked top 3 on Google (difficult KW). If I go ahead and fix these errors, I might hurt my SEO , no? like: Too Many On-Page Links 302 (Temporary Redirect) Title Element Too Long (> 70 Characters) Missing Meta Description Tag
Intermediate & Advanced SEO | | Elchanan0