Homepage indexation issue
-
Hello all,
I've been scratching my head about this one for a while now... Let me explain the situation.
I'm working on a multi-lingual website. Visitors are redirected (301) when they visit the homepage to the correct domain.com/en/default.html, domain.com/nl/default.html, domain.com/fr/default.html or domain.com/de/default.html based on browser language. I have doubts about the impact on the ability for Google to index the website because of that, but that's a problem for another day.
The problem I'm having right now, is that domain.com/nl/default.html, domain.com/de/default.html and domain.com/fr/default.html are all indexed. When I search for the URL in Google I get the correct page on number one so I'm pretty sure those are indexed correctly. When I search for domain/en/default.html though, the homepage appears without /en/default.html extension. Does this mean Google assumes the domain.com page is the same as domain.com/en/default.html even though the redirect that's in place?
Would be great if someone could shed some light on this.
Thanks in advance!
-
Questions
- This type of behavior is considered a temporary redirect. Maybe it's better to think of the name as a conditional redirect. In which case, "Oh, your browser is in FR, with that condition let's send you here..." The 301 is supposed to be used as an unconditional redirect, telling crawlers that you're trying to migrate from URL A to B permanently, so get rid of URL A.
- Not necessarily. VS a 301, yes. but scrapability is mostly down to linking and sitemaps.
- Yup.
- Nope. You'd want to interlink directly to the other languages anyways though in case the 302 doesn't work for whatever reasons. Then the link is passing authority and the user has an option available to them if they'd like to get there on their own.
- Right. It'd be best to interlink with hreflang on each as you never know for certain how someone arrives at those pages. Best to give them and crawlers the guidance to where the other translations reside.
You're welcome! Hopefully that clears it all up for you.
-
Thanks a lot for your answer. The follow up question above also continues on your answer. Would be great to hear your thoughts.
-
Thanks a lot for this one. I have never worked on these kinds of automatic redirects so I thought to stay away from them till I got the indexation issue fixed. But I understand from your answer the two might be related.
Just to clarify and make sure I'm doing the right thing.
The situation at the moment: domain.com -> browser language = EN -> 301 redirect to domain.com/en/default.htm
domain.com -> browser language = NL -> 301 redirect to domain.com/nl/default.htm
domain.com -> browser language = DE -> 301 redirect to domain.com/de/default.htm
domain.com -> browser language = FR -> 301 redirect to domain.com/fr/default.htmIn this situation using the query "site:domain.com", the results include the /de/, /nl/, /fr/ and domain.com, but excludes /en/.
You advise to change this in to: domain.com -> browser language = EN -> 302 redirect to domain.com/en/default.htm
domain.com -> browser language = NL -> 302 redirect to domain.com/nl/default.htm
domain.com -> browser language = DE -> 302 redirect to domain.com/de/default.htm
domain.com -> browser language = FR -> 302 redirect to domain.com/fr/default.htmI need to include a hreflang=x-default on the domain.com page.
A few question that pop-up in my mind:
I always thought a 302 was only used for temporarily redirects?
Does using a 302 improves the scrapability of the website?
Would it possibily result in /en/default.htm be indexed again?
Does a 302 pass along authority?
I assume I need to implement href lang on the /LANGUAGE/default.htm pages as well right?Thanks a lot!
-
As others have mentioned, using a 301 redirect in this situation is not the most efficient use case, especially if you want all versions of your site to be indexed and available to users.
For displaying regional content (e.g. you have the same content, but it is translated to a specific language on different page versions) you would want to use hreflang to tell Google that you have multiple versions and the regions they satisfy. This will allow Google to serve up the regional specific content to users in international Google search engines and Google will index/know which versions are appropriate.
Reference link: https://support.google.com/webmasters/answer/189077
Additional reference: https://support.google.com/webmasters/answer/182192?hl=en#2
-
If you can, get that 301 redirection issue solved first as it's definitely not the type of one you want to use for this behavior. Google specifically recommends, "... to automatically serve the appropriate HTML content to your users depending on their location and language settings. You will either do that by using server-side 302 redirects or by dynamically serving the right HTML content." From here: http://googlewebmastercentral.blogspot.com/2014/05/creating-right-homepage-for-your.html. They go further into the hreflang tags here: https://support.google.com/webmasters/answer/189077?hl=en.
After getting the 301 cleaned up, for finding indexed pages it's better to use the "site:" search based operator in Google, Google Webmaster Tools, and Analytics. But really, get that 301 changed. Cheers!
-
If I understand your post correctly, domain.com/de/default.html has a 301 redirect to correctly direct traffic to the appropriate home page for their language?
If that is what you are saying than the chances are the the domain.com/de/default.html is no longer being indexed because of the 301 redirect. That redirect tells the engines that the page has moved, so they stop crawling it. I am not an expert on redirecting home pages, but maybe look into Ref lang tags and REL canonical tags in place of the 301 redirect.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Content Issues: Duplicate Content
Hi there
Technical SEO | | Kingagogomarketing
Moz flagged the following content issues, the page has duplicate content and missing canonical tags.
What is the best solution to do? Industrial Flooring » IRL Group Ltd
https://irlgroup.co.uk/industrial-flooring/ Industrial Flooring » IRL Group Ltd
https://irlgroup.co.uk/index.php/industrial-flooring Industrial Flooring » IRL Group Ltd
https://irlgroup.co.uk/index.php/industrial-flooring/0 -
Structure Data Issue
HiI found few errors in Google webmaster tools under structure data. The error shows "Missing: name' but when I click 'Test Live Data' it shows 'All good'. Currently we are using Drupal CMS and please find attached error screenshot.Please advice on this issue.Thanks,SatlaqlGEyp7
Technical SEO | | TrulyTravel0 -
2 Versions of Same Homepage
We want to show new and returning visitors different versions of our homepage (same URL) What, if anything, should we use as the markup to tell Google what we are doing?
Technical SEO | | theLotter
Any danger that Google will think we are cloaking? Thanks!0 -
Why is this page not ranking but is indexed?
I have a page http://jobs.hays.co.uk/jobs-in-norfolk and it is indexed by Google but will not show up for any keywords I try. Any ideas?
Technical SEO | | S_Curtis0 -
Duplicate content /index.php/ issues
I'm having some duplicate content issues with Google. I've already got my .htaccess file working just fine as far as I can tell. Rewriting works great, and by using the site you'd never end up on a page with /index.php. However I do notice that on ANY page of the site you could add /index.php and get the same page i.e.: www.mysite.com/category/article and www.mysite.com/index.php/category/article Would both return the same page. How can I 301 or something similar all /index.php pages to the non index.php version? I have no desire for any page on my site to have index.php in it, there is no use to it. Having quite the hard time figuring this out. Again this is basically just for the robots, the URL's the users see are perfect, never had an issue with that. Just SEOMOZ reporting duplicate content and I've verified that to be true.
Technical SEO | | b18turboef1 -
Google Index Speed Opinions
Hello Everyone, Under normal circumstances, new posts to my site are indexed almost instantly by Google. I know this because an occasional search with quotation marks surrounding the 1st paragraph of text displays my newly published page. I use this tactic from time to time to ensure contributors aren't syndicating content. My question is this: I've noticed over the last day or so that my newly published articles are not yet indexed. For example, an article that was published over 24 hours ago does not appear to be indexed yet. Is this cause for concern? Is there an average wait time for indexation? XML issue? Thanks in advance for the help/insight.
Technical SEO | | JSOC0 -
Getting More Pages Indexed
We have a large E-commerce site (magento based) and have submitted sitemap files for several million pages within Webmaster tools. The number of indexed pages seems to fluctuate, but currently there is less than 300,000 pages indexed out of 4 million submitted. How can we get the number of indexed pages to be higher? Changing the settings on the crawl rate and resubmitting site maps doesn't seem to have an effect on the number of pages indexed. Am I correct in assuming that most individual product pages just don't carry enough link juice to be considered important enough yet by Google to be indexed? Let me know if there are any suggestions or tips for getting more pages indexed. syGtx.png
Technical SEO | | Mattchstick0 -
Indexing of flash files
When Google indexes a flash file, do they use a library for such a purpose ? What set me thinking was this blog post ( although old ) which states - "we expanded our SWF indexing capabilities thanks to our continued collaboration with Adobe and a new library that is more robust and compatible with features supported by Flash Player 10.1."
Technical SEO | | seoug_20050