Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

Robots.txt issue for international websites

Intermediate & Advanced SEO

811

JinnatUlHasan last edited by

In Google.co.uk, our US based (abcd.com) is showing:

A description for this result is not available because of this site's robots.txt – learn more

But UK website (uk.abcd.com) is working properly. We would like to disappear .com result totally, if possible. How to fix it?

Thanks in advance.
1 Reply Last reply
Reply Quote 0
KeriMorgret last edited by

Can you share any information about your robots.txt?
1 Reply Last reply
Reply Quote 0
JinnatUlHasan @KeriMorgret last edited by

My main problem is in the homepage. Both host similar type of products and brands.

You may check the screenshot. Sorry, I had to blanked out the text.

Thanks in advance.

8BwQKcv
1 Reply Last reply
Reply Quote 0
KeriMorgret last edited by

Is it showing that for every page, or only some pages? If so, which types of pages? What's the contents of your robots.txt file for the US site?
1 Reply Last reply
Reply Quote 0

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Pages blocked by robots

**yazılım sürecinde yapılan bir yanlışlıktı.** Sorunu hızlı bir şekilde nasıl çözebilirim? bana yardım et. ```[XTRjH](https://imgur.com/a/XTRjH)
Intermediate & Advanced SEO | | mihoreis

0
How i get link to my website

hi i'm very new in seo want to have links to my website:www.warningbroker.com how i can get links to my website?
Intermediate & Advanced SEO | | marketing66

0
Viewing search results for 'We possibly have internal links that link to 404 pages. What is the most efficient way to check our sites internal links?

We possibly have internal links on our site that point to 404 pages as well as links that point to old pages. I need to tidy this up as efficiently as possible and would like some advice on the best way to go about this.
Intermediate & Advanced SEO | | andyheath

0
SEO issues? New functionality added to website and now hash (in URL) - fragments

Hi All! We have new nice functionality on website, but now i doubt if we will have SEO issues. Duplicate content and if google is able to spider our website. See: http://www.allesvoorbbq.nl/boretti-da-vinci-nero.html#608=1370
With the new functionality we can switch between colors of the models (black / white / red / yellow).
When you switch with Ajax the content of other models is fetched without refreshing the page. (so the url initial part of url stays the same (for initial model) only part behind # changes. The other models are also accessible by there own url, like the red one: http://www.allesvoorbbq.nl/boretti-da-vinci-rosso.html#608=1372 So far so good. But now the questions: 1. We use to have url like /boretti-da-vinci-nero.html - also our canonical is that way But now if we access that url our system is adding automatically the #123-123 to the url to indicate which model(color) is shown. Is this hurting SEO or confusing google? Because it seems that the clean url is not accessible anymore? (it adds now #123-123) 2. Should we add some tags around the different types (colors) to prevent google from indexing that part of website? Every info would be very helpfull! We do not want to lose our nice rankings thanks to MOZ! Thanks all!
Jeroen
Intermediate & Advanced SEO | | RetailClicks

0
Can I use the old website content on the new website, after deleting it from the server?

My website nowwhatstudio.com hit by google pure spam and google applied manual spam action to the website. I create new website (nowwhatmoments.com) with the same content from the old spam action website (nowwhatstudio.com). As google removed my old website content from search indexed. Can I use the same content for a new website? If I delete my old website from the server, after that Can I use the old website content for a new website? Or Can make edits the old website content and make it 80% original for a new website?
Intermediate & Advanced SEO | | bondhoward

0
International SEO Question

_The company I work for has a website www.example.com that ranks very well in English speaking countries - US, UK, CA. For legal reasons, we now need to create www.example.co.uk to be accessible and rank in google.co.uk. Obviously we want this change to be as smooth as possible with little effect on rankings in the UK. We have two options that we're talking through at the moment - Use the hreflang tag on both the .com and the .co.uk to tell Google which site to rank in each country. My worry with this is that we might lose our rankings in the UK as it will be a brand new site with little to no links pointing to it. 301 redirect to the .co.uk based on UK IP addresses. I'm skeptical about this. As a 301 passes most of the link juice, I'm not sure how Google would treat this type of thing - would the .com lose ranking? So my questions are - would we lose ranking in the UK if we use option 1? Would option 2 work? What would you do? Any help is appreciated._
Intermediate & Advanced SEO | | awestwood

0
International SEO

Hi all, The company that I work for is planning to target some french (and some other foreign) keywords. The thing is, in our industry, you can't just hire someone to translate the content/pages. The pages have to be translated by an accredited translator. Here's the thing, it costs a LOT of money just to translate a few thousand words. So, the CEO decided to translate a few of our 'core' pages and SEO them to see if it brings results. My questions are, would it be possible from a technical point of view to simply translate a few pages? Would that cause a problem for the search engine crawlers? Would those pages be 'seen' as duplicates? Thanks in advance guys!
Intermediate & Advanced SEO | | EdwardDennis

0
Removed Internal Rel=NoFollows from power internal page - how long till reflected in Google?

I just started with a client, who has an internal page (not the homepage) that gets about 70% of all total links to the site and ranks #1 for a highly competitive keyword. For some reason, the first set of links, including the first anchor text link to the homepage are nofollowed. I removed the nofollows yesterday. Today, The internal page has already been reindexed in Google showing the followed anchor text link to the homepage Should I expect a jump in link juice pointing to my homepage immediately with a corresponding rankings boost? Homepage is #8 for target term. I hope this makes sense. Any advice would be greatly appreciated.
Intermediate & Advanced SEO | | MattAaron

0