Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Do YouTube videos in iFrames get crawled?
-
There seems to be quite a few articles out there that say iframes cause problems with organic search and that the various bots can't/won't crawl them. Most of the articles are a few years old (including Moz's video sitemap article). I'm wondering if this is still the case with YouTube/Vimeo/etc videos, all of which only offer iFrames as an embed option.
I have a hard time believing that a Google property (YT) would offer an embed option that it's own bot couldn't crawl. However, let me know if that is in fact the case.
Thanks!
Jim
-
Hi Joricia,
What do you use for transcribing? I've tried Dragon but it's video transcription function is useless. Don't really have the money to get everything manually transcribed.
Thanks,
Jim
-
If you do not want to take the gamble with I-frames and want to be certain that your content is found by Google I would use Wistia it comes with everything that you need in order to have a video indexed the proper embed code, video site map and schema you can use third-party companies like "speechpad" to transcribe what is being spoken. Wistia also offers A similar service.
If you do choose to use YouTube I would reembed the video with embedly rember you will have to create your own video XML sitemap, add your own schema you may use to YouTube content to a website without having to worry about Google not being able to index because the I-frame is converted into a readable code.
This is a great resource on video SEO. Because I can tell you using Frist hand by using this method it will work.
https://www.distilled.net/blog/video/video-seo-tactics-to-get-ranked/
Sorry I did not explain more in my first response.
Tom
-
They all sort of help, but basically just reconfirms what's out there... nobody seems to know for sure. It seems iframes sometimes get crawled but sometimes not. For Mobile, Google recommends iframes but doesn't say specifically that they get crawled and then elsewhere they say there's limited support for them.
It's frustrating Google can't just provide clear guidance on the subject.
While the answer might be Vzaar or Wistia, they have drawbacks and there are times where YouTube is the better choice even if you use one of the other services. So understanding the best way to embed them seems important.
-
Hi Jim!
Do any of these responses help?

-
Google actually can crawl iframes, but the support is limited. Try indexing it with robots.txt or add the URL of the frame you'd like to have crawled in Google Webmaster Tools. Since an iframe is basically an HTML document inside an HTML document, it's not going to crawl the whole page together with the iframe, making its SEO value lower than if it were outside the iframe. A good tactic is to also have content surrounding the iframe on page that describes what is inside the iframe.
And since we're on the topic of videos inside iframes, make sure you have transcripts for it. Google does use those as well as deaf users, so you're doing a good turn for your client and for those with disabilities.
But to answer the root of your question, you're right we don't actually know if Google has a system setup to specifically make it easier to crawl Youtube videos inside iframes. As transparent as Google has been this past year they're still pretty mysterious overall.
-
iframes do not get crawled but there are other ways or Google to see videos that link back to your site Moz uses Wistia.com they are spectacular and their embed code and site map make them easily findable
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Moz crawler is not able to crawl my website
Hi, i need help regarding Moz Can't Crawl Your Site i also share screenshot that Moz was unable to crawl your site on Mar 26, 2022. Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster.
Technical SEO | | JasonTorney
my robts.txt also ok i checked it
Here is my website https://whiskcreative.com.au
just check it please as soon as possibe0 -
URLs dropping from index (Crawled, currently not indexed)
I've noticed that some of our URLs have recently dropped completely out of Google's index. When carrying out a URL inspection in GSC, it comes up with 'Crawled, currently not indexed'. Strangely, I've also noticed that under referring page it says 'None detected', which is definitely not the case. I wonder if it could be something to do with the following? https://www.seroundtable.com/google-ranking-index-drop-30192.html - It seems to be a bug affecting quite a few people. Here are a few examples of the URLs that have gone missing: https://www.ihasco.co.uk/courses/detail/sexual-harassment-awareness-training https://www.ihasco.co.uk/courses/detail/conflict-resolution-training https://www.ihasco.co.uk/courses/detail/prevent-duty-training Any help here would be massively appreciated!
Technical SEO | | iHasco0 -
How to allow bots to crawl all but WP-content
Hello, I would like my website to remain crawlable to bots, but to block my wp content and media. Does the following robots.txt work? I worry that the * user agent may conflict with the others. User-agent: *
Technical SEO | | Tom3_15
Disallow: /wp-admin/
Disallow: /wp-includes/
Disallow: /wp-content/ User-agent: GoogleBot
Allow: / User-agent: GoogleBot-Mobile
Allow: / User-agent: GoogleBot-Image
Allow: / User-agent: Bingbot
Allow: / User-agent: Slurp
Allow: /0 -
Do URLs with canonical tags get indexed by Google?
Hi, we re-branded and launched a new website in February 2016. In June we saw a steep drop in the number of URLs indexed, and there have continued to be smaller dips since. We started an account with Moz and found several thousand high priority crawl errors for duplicate pages and have since fixed those with canonical tags. However, we are still seeing the number of URLs indexed drop. Do URLs with canonical tags get indexed by Google? I can't seem to find a definitive answer on this. A good portion of our URLs have canonical tags because they are just events with different dates, but otherwise the content of the page is the same.
Technical SEO | | zasite0 -
Can spiders crawl jQuery Fancy Box scripts
Hi Everyone - I'm not a technical person at all. I have some content that will be hidden until a user clicks "learn more" where upon it will be displayed via jQuery Fancy Box script. The content behind the learn more javascript is important and I need it to be crawled by search engine spiders. Does anyone know if there will be a problem with this script?
Technical SEO | | Santaur0 -
Googlebot Crawl Rate causing site slowdown
I am hearing from my IT department that Googlebot is causing as massive slowdown/crash our site. We get 3.5 to 4 million pageviews a month and add 70-100 new articles on the website each day. We provide daily stock research and marke analysis, so its all high quality relevant content. Here are the crawl stats from WMT: http://imgur.com/dyIbf I have not worked with a lot of high volume high traffic sites before, but these crawl stats do not seem to be out of line. My team is getting pressure from the sysadmins to slow down the crawl rate, or block some or all of the site from GoogleBot. Do these crawl stats seem in line with sites? Would slowing down crawl rates have a big effect on rankings? Thanks
Technical SEO | | SuperMikeLewis0 -
When is the last time Google crawled my site
How do I tell the last time Google crawled my site. I found out it is not the "Cache" which I had thought it was.
Technical SEO | | digitalops0 -
Video Sitemaps <video:content_loc>and<video:player_loc></video:player_loc></video:content_loc>
Hi guys, If I'm creating a video sitemap do I need to use both: video:content_locandvideo:player_loc</video:player_loc></video:content_loc> Or could I just use video:content_loc?</video:content_loc> Thanks
Technical SEO | | Tug-Agency0