Javascript content not being indexed by Google
-
I thought Google has gotten better at picking up unique content from javascript. I'm not seeing it with our site. We rate beauty and skincare products using our algorithms. Here is an example of a product -- https://www.skinsafeproducts.com/tide-free-gentle-he-liquid-laundry-detergent-100-fl-oz
When you look at the cache page (text) from google none of the core ratings (badges like fragrance free, top free and so forth) are being picked up for ranking. Any idea what we could do to have the rating incorporated in the indexation.
-
Hello!
Pretty sure the issue is that this content requires a user action before being seen. Google will not crawl/index content which is not loaded until the user interacts. This post is a great resource %20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.)on JS auditing/crawling%20Summary:%20How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%20%20%20Name:%20Heather%20Huhman%20Spark%20Hire%20%20Category:%20Business%20and%20Finance%20%20%20Email:%20query-7wru@helpareporter.net%20%20%20Media%20Outlet:%20Spark%20Hire%20%20Deadline:%205:00%20PM%20EST%20-%2023%20April%20%20%20Query:%20%20%20LinkedIn's%20most%20recent%20Global%20Recruiting%20Trends%20report,%20recruiters%20say%20their%20top%20focus%20is%20on%20diversity%20and%20inclusion.%20But%20when%20it%20comes%20to%20hiring%20for%20diversity,%20there's%20a%20misunderstanding%20that%20the%20focus%20must%20be%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates.%20We're%20looking%20for%20insight%20into%20how%20hiring%20pros%20can%20break%20out%20of%20that%20rigid%20diversity%20box%20and%20find%20creative%20ways%20to%20hire%20diverse%20candidates%20who%20will%20positively%20impact%20various%20aspects%20of%20their%20company.%20Responses%20that%20are%20selected%20will%20be%20featured%20on%20the%20Spark%20Hire%20blog%20and%20promoted%20to%20over%2010K%20blog%20subscribers.%20%20Please%20respond%20to%20the%20following%20questions:%20%20How%20can%20focusing%20only%20on%20the%20ethnicity,%20race,%20and%20sex%20of%20candidates%20hurt%20hiring%20pros'%20efforts%20of%20hiring%20the%20best%20diverse%20candidates?%20What%20other%20candidate%20factors%20can%20hiring%20pros%20look%20into%20to%20find%20diverse%20candidates?%20Please%20share%20a%20story%20of%20a%20time%20when%20you%20or%20a%20fellow%20hiring%20pro%20narrowed%20your%20diversity%20focus%20too%20much,%20resulting%20in%20hires%20that%20weren%27t%20the%20best%20fit%20for%20the%20company.%20How%20can%20hiring%20professionals%20create%20a%20unique%20hiring%20strategy%20to%20attract%20diverse%20candidates%20who%20are%20the%20best%20fit%20for%20their%20open%20roles%20and%20company?%20%20Requirements:%20%20%20Please%20send%20your%20input%20in%20your%20initial%20response%20(don%27t%20send%20requests%20for%20interviews%20or%20article%20links).%20Include%20%22How%20to%20Make%20Your%20Company%20Diverse%20Without%20Focusing%20on%20Diversity%22%20in%20the%20subject%20line.%20Answer%20each%20question%20separately.%20Keep%20answers%20brief%20but%20informative.%20%20Include:%20%20Your%20title%20and%20qualifications%20Contact%20information,%20including%20an%20email%20Headshot%20(must%20be%20a%20link%20and%20at%20least%20200x200)%20Twitter%20handle%20%20Thank%20You.) and will show you how to use Chrome's 'inspect element' as a better way to see what's going on.
But in general, the content needs to load before a user action takes place (even if in JS) and yes Google is getting better, but won't look at anything behind a click. Google just confirmed this at their recent I/O conference, stating that they do render JavaScript but it could be a week after they first render the normal HTML.
-Dan
PS - Huge apologies for the delay in answering, Moz was having technical issues with the backend of the forum, affecting the ability to reply to some questions.
-
Hi akih,
I don't believe the "text-only" cache is representative of Google's index. They process JavaScript via their rendering service before they index content - so the full cached version is a more accurate representation of the content Google has seen/indexed.
Also, I ran a search for your site using a snippet of copy from the "Common Preservative Free" badge, and Google is returning pages with this text in the displayed page description. Here's a link to the SERP for the query I used.
I'd say Google's able to see and index this content just fine - it's just the "text-only" cached content does not include any JavaScript-rendered content.
Best,
Mike
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Why do SEO agencies ask for access to our Google Search Console and Google Tag Manager?
What do they need GTM for? And what is the use case for setting up Google Search Console?
Intermediate & Advanced SEO | | NBJ_SM0 -
What to do if lots of backend pages have been indexed by Google erroneously?
Hi Guys Our developer forgot to add a no index no follow tag on the pages he created in the back-end. So we have now ended up with lots of back end pages being indexed in google. So my question is, since many of those are now indexed in Google, so is it enough to just place a no index no follow on those or should we do a 301 redirect on all those to the most appropriate page? If a no index no follow is enough, that would create lots of 404 errors so could those affect the site negatively? Cheers Martin
Intermediate & Advanced SEO | | martin19700 -
Is it a good strategy to link older content that was timely at one point to newer content that we would prefer to guide traffic and value to
Hi All, I've been working for a website/publisher that produces good content and has been around for a long time but has recently been burdened by a high level of repetitious production, and a high volume in general with pages that don't gather as much traffic as desired. One such fear of mine is that every piece published doesn't have any links pointing to when it is published outside of the homepage or syndicated referrals. They do however have a lot (perhaps too many) outbound internal links away from it. Would it be a good practice, especially for new content that has a longer shelf life, to go back to older content and place links pointing to the new one? I would hope this would boost traffic via internal recircultion and Page Authority, with the added benefits of anchor text boosts.
Intermediate & Advanced SEO | | ajranzato91 -
Why isn't Google indexing this site?
Hello, Moz Community My client's site hasn't been indexed by Google, although it was launched a couple of months ago. I've ran down the check points in this article https://moz.com/ugc/8-reasons-why-your-site-might-not-get-indexed without finding a reason why. Any sharp SEO-eyes out there who can spot this quickly? The url is: http://www.oldermann.no/ Thank you
Intermediate & Advanced SEO | | Inevo
INEVO, digital agency0 -
Google Indexed my Site then De-indexed a Week After
Hi there, I'm working on getting a large e-commerce website indexed and I am having a lot of trouble.
Intermediate & Advanced SEO | | Travis-W
The site is www.consumerbase.com. We have about 130,000 pages and only 25,000 are getting indexed. I use multiple sitemaps so I can tell which product pages are indexed, and we need our "Mailing List" pages the most - http://www.consumerbase.com/mailing-lists/cigar-smoking-enthusiasts-mailing-list.html I submitted a sitemap a few weeks ago of a particular type of product page and about 40k/43k of the pages were indexed - GREAT! A week ago Google de-indexed almost all of those new pages. Check out this image, it kind of boggles my mind and makes me sad. http://screencast.com/t/GivYGYRrOV While these pages were indexed, we immediately received a ton of traffic to them - making me think Google liked them. I think our breadcrumbs, site structure, and "customers who viewed this product also viewed" links would make the site extremely crawl-able. What gives?
Does it come down to our site not having enough Domain Authority?
My client really needs an answer about how we are going to get these pages indexed.0 -
Our login pages are being indexed by Google - How do you remove them?
Each of our login pages show up under different subdomains of our website. Currently these are accessible by Google which is a huge competitive advantage for our competitors looking for our client list. We've done a few things to try to rectify the problem: - No index/archive to each login page Robot.txt to all subdomains to block search engines gone into webmaster tools and added the subdomain of one of our bigger clients then requested to remove it from Google (This would be great to do for every subdomain but we have a LOT of clients and it would require tons of backend work to make this happen.) Other than the last option, is there something we can do that will remove subdomains from being viewed from search engines? We know the robots.txt are working since the message on search results say: "A description for this result is not available because of this site's robots.txt – learn more." But we'd like the whole link to disappear.. Any suggestions?
Intermediate & Advanced SEO | | desmond.liang1 -
How can you indexed pages or content on pages that are behind a pay wall or subscription login.
I have a client that has a boat of awesome content they provide to their client that's behind a pay wall ( ie: paid subscribers can only access ) Any suggestions mozzers? How do I get those pages index? Without completely giving away the contents in the front end.
Intermediate & Advanced SEO | | BizDetox0 -
Link to Google Places, or Google Maps?
On our contact page, we offer a link to view Google Maps for directions. I'm wondering should we be linking to our Google Places page instead, or just stick with the Google Map link? Thanks!
Intermediate & Advanced SEO | | GravitateMCC0