Javascript content not being indexed by Google
-
I thought Google has gotten better at picking up unique content from javascript. I'm not seeing it with our site. We rate beauty and skincare products using our algorithms. Here is an example of a product -- https://www.skinsafeproducts.com/tide-free-gentle-he-liquid-laundry-detergent-100-fl-oz
When you look at the cache page (text) from google none of the core ratings (badges like fragrance free, top free and so forth) are being picked up for ranking. Any idea what we could do to have the rating incorporated in the indexation.
-
Hello!
Pretty sure the issue is that this content requires a user action before being seen. Google will not crawl/index content which is not loaded until the user interacts. This post is a great resource %20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.)on JS auditing/crawling%20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.) and will show you how to use Chrome's 'inspect element' as a better way to see what's going on.
But in general, the content needs to load before a user action takes place (even if in JS) and yes Google is getting better, but won't look at anything behind a click. Google just confirmed this at their recent I/O conference, stating that they do render JavaScript but it could be a week after they first render the normal HTML.
-Dan
PS - Huge apologies for the delay in answering, Moz was having technical issues with the backend of the forum, affecting the ability to reply to some questions.
-
Hi akih,
I don't believe the "text-only" cache is representative of Google's index. They process JavaScript via their rendering service before they index content - so the full cached version is a more accurate representation of the content Google has seen/indexed.
Also, I ran a search for your site using a snippet of copy from the "Common Preservative Free" badge, and Google is returning pages with this text in the displayed page description. Here's a link to the SERP for the query I used.
I'd say Google's able to see and index this content just fine - it's just the "text-only" cached content does not include any JavaScript-rendered content.
Best,
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Will I be flagged for duplicate content by Google?
Hi Moz community, Had a question regarding duplicate content that I can't seem to find the answer to on Google. My agency is working on a large number of franchisee websites (over 40) for one client, a print franchise, that wants a refresh of new copy and SEO. Each print shop has their own 'microsite', though all services and products are the same, the only difference being the location. Each microsite has its own unique domain. To avoid writing the same content over and over in 40+ variations, would all the websites be flagged by Google for duplicate content if we were to use the same base copy, with the only changes being to the store locations (i.e. where we mention Toronto print shop on one site may change to Kelowna print shop on another)? Since the print franchise owns all the domains, I'm wondering if that would be a problem since the sites aren't really competing with one another. Any input would be greatly appreciated. Thanks again!
Intermediate & Advanced SEO | | EdenPrez0 -
Shall we add engaging and useful FAQ content in all our pages or rather not because of duplication and reduction of unique content?
We are considering to add at the end of alll our 1500 product pages answers to the 9 most frequently asked questions. These questions and answers will be 90% identical for all our products and personalizing them more is not an option and not so necessary since most questions are related to the process of reserving the product. We are convinced this will increase engagement of users with the page, time on page and it will be genuinely useful for the visitor as most visitors will not visit the seperate FAQ page. Also it will add more related keywords/topics to the page.
Intermediate & Advanced SEO | | lcourse
On the downside it will reduce the percentage of unique content per page and adds duplication. Any thoughts about wether in terms of google rankings we should go ahead and benefits in form of engagement may outweight downside of duplication of content?0 -
Will disallowing URL's in the robots.txt file stop those URL's being indexed by Google
I found a lot of duplicate title tags showing in Google Webmaster Tools. When I visited the URL's that these duplicates belonged to, I found that they were just images from a gallery that we didn't particularly want Google to index. There is no benefit to the end user in these image pages being indexed in Google. Our developer has told us that these urls are created by a module and are not "real" pages in the CMS. They would like to add the following to our robots.txt file Disallow: /catalog/product/gallery/ QUESTION: If the these pages are already indexed by Google, will this adjustment to the robots.txt file help to remove the pages from the index? We don't want these pages to be found.
Intermediate & Advanced SEO | | andyheath0 -
Duplicate Content: Is a product feed/page rolled out across subdomains deemed duplicate content?
A company has a TLD (top-level-domain) which every single product: company.com/product/name.html The company also has subdomains (tailored to a range of products) which lists a choosen selection of the products from the TLD - sort of like a feed: subdomain.company.com/product/name.html The content on the TLD & subdomain product page are exactly the same and cannot be changed - CSS and HTML is slightly differant but the content (text and images) is exactly the same! My concern (and rightly so) is that Google will deem this to be duplicate content, therfore I'm going to have to add a rel cannonical tag into the header of all subdomain pages, pointing to the original product page on the TLD. Does this sound like the correct thing to do? Or is there a better solution? Moving on, not only are products fed onto subdomain, there are a handfull of other domains which list the products - again, the content (text and images) is exactly the same: other.com/product/name.html Would I be best placed to add a rel cannonical tag into the header of the product pages on other domains, pointing to the original product page on the actual TLD? Does rel cannonical work across domains? Would the product pages with a rel cannonical tag in the header still rank? Let me know if there is a better solution all-round!
Intermediate & Advanced SEO | | iam-sold0 -
Multiple 301 redirects and old site content appearing in Google results
I have found that for some Google searches the old version of the site on a completely different domain is appearing on page one of the results, while the newer site is only on page 3. The old site is redirecting to the new site with a 301 redirect, however there is also an additional redirect on the new site to force SSL. Despite this when you view the Google cache of the result that appears in Google the content of the page is still the old site. Is this normal or is Google not following the chain of 301 redirects? Edit: I just found out that downloading the page by right clicking a link and clicking download rather than viewing it in a browser leads to the old site appearing and the 301 redirect not being followed.
Intermediate & Advanced SEO | | freshleafmedia0 -
Does Google penalise content that sits behind a read gate?
Does Google penalise content that sits behind a read gate? Currently, most of the content on our site sits behind a read gate. People have to register before they can view the detailed content. Currently, our forums are accessible to all which draws a lot of long tail traffic. Google does seem to be indexing some of our gated content, but can someone advise me how they view this content more generally please?
Intermediate & Advanced SEO | | RG_SEO0 -
How to remove wrong crawled domain from Google index
Hello, I'm running a Wordpress multisite. When I create a new site for a client, we do the preparation using the multisite domain address (ex: cameleor.cobea.be). To keep the site protected we use the "multisite privacy" plugin which allows us to restrict the site to admin only. When site is ready we a domain mapping plugin to redirect the client domain to the multisite (ex: cameleor.com). Unfortunately, recently we switched our domain mappin plugin by another one and 2 sites got crawled by Google on their multsite address as well. So now when you type "cameleor" in Google you get the 2 domains in SERPS (see here http://screencast.com/t/0wzdrYSR). It's been 2 weeks or so that we fixed the plugin issue and now cameleor.cobea.be is redirected to the correct address cameleor.com. My question: how can I get rid of those wrong urls ? I can't remove it in Google Webmaster Tools as they belong to another domain (cf. cameleor.cobea.be for which I can't get authenticated) and I wonder if will ever get removed from index as they still redirect to something (no error to the eyes of Google)..? Does anybody has an idea or a solution for me please ? Thank you very much for your help Regards Jean-Louis
Intermediate & Advanced SEO | | JeanlouisSEO0 -
Google replacing subpages in index with home page?
Hi! I run a backlink building company. Recently, we had a customer who had us build targeted backlinks to certain subpages on his site. Then something really bizarre happened...all of a sudden, their subpages that were indexed in Google (the ones we were building links to) disappeared from the index, to be replaced with their home page. They haven't lost their rank, per se--it's just now their home page instead of their subpages. At this point, we are tracking literally thousands of keywords for our link building customers, and we've never run into this issue before. Have you ever run into it? If so, what's the best way to handle it from an SEO company perspective? They have a sitemap.xml and their GWT account reports no crawl errors, so it doesn't seem to be a site issue.
Intermediate & Advanced SEO | | ownlocal0