Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Other domains hosted on same server showing up in SERP for 1st site's keywords
-
For the website in question, the first domain alphabetically on the shared hosting space, strange search results are appearing on the SERP for keywords associated with the site.
Here is an example:
A search for "unique company name" shows the results: www.uniquecompanyname.com as the top result.
But on pages 2 and 3, we are getting results for the same content but for domains hosted on the same server. Here are some examples with the domain name replaced:
UNIQUE DOMAIN NAME PAGE TITLE
ftp.DOMAIN2.com/?action=news&id=63
META DESCRIPTION TEXTUNIQUE DOMAIN NAME PAGE TITLE 2
www.DOMAIN3.com/?action=news&id=120
META DESCRIPTION TEXT2UNIQUE DOMAIN NAME PAGE TITLE 2
www.DOMAIN4.com/?action=news&id=120
META DESCRIPTION TEXT2UNIQUE DOMAIN NAME PAGE TITLE 3
mail.DOMAIN5.com/?action=category&id=17
META DESCRIPTION TEXT3ns5.DOMAIN6.com/?action=article&id=27
There are more but those are just some examples.
These other domain names being listed are other customer domains on the same VPS shared server. When clicking the result the browser URL still shows the other customer domain name B but the content is usually the 404 page. The page title and meta description on that page is not displayed the same as on the SERP.As far as we can tell, this is the only domain this is occurring for.So far, no crawl errors detected in Webmaster Tools and moz crawl not completed yet.
-
For those that are interested, we figured out the root of the problem and the fix. Maybe this will help someone down the road. Thanks to all that responded.
As it seems all the domains/accounts hosted on our VPS are top level; so we couldn’t use robots.txt to fix this.The problem:
-We have a handful of websites using a shared IP address – Only sites with SSL cert get a dedicated IP
-Some of these websites have additional A record DNS names (mail.domain1, ns5.domain2, etc) that all resolve to that shared IP address
-Within your browser if you went to one of those records it would pull up the website (account) that is first alphabetically within that shared IP pool
-It’s assumed that a website or multiple websites somewhere in the web must have linked these domain names somewhere on their webpages – so search engines crawled them for the content of that first alphabetical website
-Search engines then indexed the content of that site for these other DNS A records and displayed the alternate URLs in the SERPSThe fix:
Edit Apache’s httpd.conf file on our VPS – adding a new (first listed) virtual directory of that shared IP address to point to the servers cpanel default cgi page instead of listing one of our hosted accounts first.
This page describes what we needed done and what fixed it for us: http://forums.spry.com/cpanel-whm/1568-how-can-i-change-default-page-ip-address-points.html
Thanks again!
-
You should be able to resolve this with robots.txt and .htaccess files, but one more thing I've learned to do is to use a domain name for the primary domain that I do not plan to submit to Google for indexing. For example, I'll use arbitrary color names like silverblue.net as the primary domain and then the domains I intend to index will be virtual domains. This isn't really necessary but it helps me keep all my domain names straight in my head and avoid the issue you described above.
Best,
Christopher -
Thanks for the replies, guys. We are going to try Christopher's suggestion first and we'll update the question when it's resolved!
-
The other domains are ours, yes.
Oh, that's a horse of a different color. If you have multiple domains on one account, one domain will be the primary domain and the other domains will be virtual domains. If you look at the file structure on your server, all the virtual domains will be sub-folders under the primary domain. You need to create a robots.txt file in the primary domain that blocks the spiders from discovering the other domains through the sub-directory structure. Otherwise, all the virtual domains will be duplicated, once via the primary domain and again via the virtual domain.
Best,
Christopher -
The other domains are ours, yes.
I don't think any of them are using Joomla.
-
Are those other domains also yours, by any chance and/or is this a Joomla cms?
-
Wow... that's not so ideal. My guess is that all of those sites are sharing the same IP address, and the server's settings are such that if you hit the IP address with a forward slash (i.e. http://00.00.00.00/domainname/) it's showing content.
My $0.02 is to find a new hosting company.... and one that gives each site it's own IP address instead of doing shared-level hosting with the same IP address in a name-based space.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Combining Two Sites With Similar Domain Authority
Hello, We run two sites with the same product, product descriptions and url structure. Essentially, the two sites are the same except for domain name and minor differences on the home pages. We've run this way for quite a few years. Both sites have a domain authority of 48 and there are not a large number of duplicate incoming links. I understand the "book" to say we should combine the sites with 301's to the similar pages. I am concerned about doing this because "site 2" still does about 20% of our business. We have been losing organic traffic for a number of years. I think this mainly has to do with a more competitive environment. However, where google used to serve both our sites for a search term it now will only show one. How much organic benefit should we see if we combine. Will it be significant enough to merge the two sites. Understandably, I realize the future can't be predicted but I would like to know if anyone has had a similar experience or opinion Thanks
Intermediate & Advanced SEO | | ffctas0 -
My site shows 503 error to Google bot, but can see the site fine. Not indexing in Google. Help
Hi, This site is not indexed on Google at all. http://www.thethreehorseshoespub.co.uk Looking into it, it seems to be giving a 503 error to the google bot. I can see the site I have checked source code Checked robots Did have a sitemap param. but removed it for testing GWMT is showing 'unreachable' if I submit a site map or fetch Any ideas on how to remove this error? Many thanks in advance
Intermediate & Advanced SEO | | SolveWebMedia0 -
ScreamingFrog won't crawl my site.
Hey guys, My site is Netspiren.dk and when I use a tool like Screaming Frog or Integrity, it only crawls my homepage and menu's - not product-pages. Examples
Intermediate & Advanced SEO | | FrederikTrovatten22
A menu: http://www.netspiren.dk/pl/Helse-Kosttilskud-Blandingsolie_57699.aspx
A product: http://www.netspiren.dk/pi/All-Omega-3-6-9-180-kapsler_1412956_57699.aspx Is it because the products are being loaded in Javascript?
What's your recommendation? All best,
Fred.0 -
Why does a site have no domain authority?
A website was built and launched eight months ago, and their domain authority is 1. When a site has been live for a while and has such a low DA, what's causing it?
Intermediate & Advanced SEO | | optimalwebinc0 -
Should I 'nofollow' links between my own sites?
We have five sites which are largely unrelated but for cross-promotional purpose our company wishes to cross link between all our sites, possibly in the footer. I have warned about potential consequences of cross-linking in this way and certainly don't want our sites to be viewed as some sort of 'link ring' if they all link to one another. Just wondering if linking between sites you own really is that much of an issue and whether we should 'nofollow' the links in order to prevent being slapped with any sort of penalty for cross-linking.
Intermediate & Advanced SEO | | simon_realbuzz0 -
How to prevent 404's from a job board ?
I have a new client with a job listing board on their site. I am getting a bunch of 404 errors as they delete the filled jobs. Question: Should we leave the the jobs pages up for extra content and entry points to the site and put a notice like this job has been filled, please search our other job listings ? Or should I no index - no follow these pages ? Or any other suggestions - it is an employment agency site. Overall what would be the best practice going forward - we are looking at probably 20 jobs / pages per month.
Intermediate & Advanced SEO | | jlane90 -
Does Google crawl the pages which are generated via the site's search box queries?
For example, if I search for an 'x' item in a site's search box and if the site displays a list of results based on the query, would that page be crawled? I am asking this question because this would be a URL that is non existent on the site and hence am confused as to whether Google bots would be able to find it.
Intermediate & Advanced SEO | | pulseseo0 -
Is 404'ing a page enough to remove it from Google's index?
We set some pages to 404 status about 7 months ago, but they are still showing in Google's index (as 404's). Is there anything else I need to do to remove these?
Intermediate & Advanced SEO | | nicole.healthline0