Moz Q&A is closed.
After more than 13 years, and tens of thousands of questions, Moz Q&A closed on 12th December 2024. Whilst we’re not completely removing the content - many posts will still be possible to view - we have locked both new posts and new replies. More details here.
Do YouTube videos in iFrames get crawled?
-
There seems to be quite a few articles out there that say iframes cause problems with organic search and that the various bots can't/won't crawl them. Most of the articles are a few years old (including Moz's video sitemap article). I'm wondering if this is still the case with YouTube/Vimeo/etc videos, all of which only offer iFrames as an embed option.
I have a hard time believing that a Google property (YT) would offer an embed option that it's own bot couldn't crawl. However, let me know if that is in fact the case.
Thanks!
Jim
-
Hi Joricia,
What do you use for transcribing? I've tried Dragon but it's video transcription function is useless. Don't really have the money to get everything manually transcribed.
Thanks,
Jim
-
If you do not want to take the gamble with I-frames and want to be certain that your content is found by Google I would use Wistia it comes with everything that you need in order to have a video indexed the proper embed code, video site map and schema you can use third-party companies like "speechpad" to transcribe what is being spoken. Wistia also offers A similar service.
If you do choose to use YouTube I would reembed the video with embedly rember you will have to create your own video XML sitemap, add your own schema you may use to YouTube content to a website without having to worry about Google not being able to index because the I-frame is converted into a readable code.
This is a great resource on video SEO. Because I can tell you using Frist hand by using this method it will work.
https://www.distilled.net/blog/video/video-seo-tactics-to-get-ranked/
Sorry I did not explain more in my first response.
Tom
-
They all sort of help, but basically just reconfirms what's out there... nobody seems to know for sure. It seems iframes sometimes get crawled but sometimes not. For Mobile, Google recommends iframes but doesn't say specifically that they get crawled and then elsewhere they say there's limited support for them.
It's frustrating Google can't just provide clear guidance on the subject.
While the answer might be Vzaar or Wistia, they have drawbacks and there are times where YouTube is the better choice even if you use one of the other services. So understanding the best way to embed them seems important.
-
Hi Jim!
Do any of these responses help?
-
Google actually can crawl iframes, but the support is limited. Try indexing it with robots.txt or add the URL of the frame you'd like to have crawled in Google Webmaster Tools. Since an iframe is basically an HTML document inside an HTML document, it's not going to crawl the whole page together with the iframe, making its SEO value lower than if it were outside the iframe. A good tactic is to also have content surrounding the iframe on page that describes what is inside the iframe.
And since we're on the topic of videos inside iframes, make sure you have transcripts for it. Google does use those as well as deaf users, so you're doing a good turn for your client and for those with disabilities.
But to answer the root of your question, you're right we don't actually know if Google has a system setup to specifically make it easier to crawl Youtube videos inside iframes. As transparent as Google has been this past year they're still pretty mysterious overall.
-
iframes do not get crawled but there are other ways or Google to see videos that link back to your site Moz uses Wistia.com they are spectacular and their embed code and site map make them easily findable
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Unsolved Why My site pages getting video index viewport issue?
Hello, I have been publishing a good number of blogs on my site Flooring Flow. Though, there's been an error of the video viewport on some of my articles. I have tried fixing it but the error is still showing in Google Search Console. Can anyone help me fix it out?
Technical SEO | | mitty270 -
520 Error from crawl report with Cloudflare
I am getting a lot of 520 Server Error in crawl reports. I see this is related to Cloudflare. We know 520 is Cloudflare so maybe the Moz team can change this from "unknown" to "Cloudflare 520". Perhaps the Moz team can update the "how to fix" section in the reporting, if they have some possible suggestions on how to avoid seeing these in the report of if there is a real issue that needs to be addressed. At this point I don't know. There must be a solution that Moz can provide like a setting in Cloudflare that will permit the Rogerbot if Cloudflare is blocking it because it does not like its behavior or something. It could be that Rogerbot is crawling my site on a bad day or at a time when we were deploying a massive site change. If I know when my site will be down can I pause Rogerbot? I found this https://developers.cloudflare.com/support/troubleshooting/general-troubleshooting/troubleshooting-crawl-errors/
Technical SEO | | awilliams_kingston0 -
Moz crawler is not able to crawl my website
Hi, i need help regarding Moz Can't Crawl Your Site i also share screenshot that Moz was unable to crawl your site on Mar 26, 2022. Our crawler was not able to access the robots.txt file on your site. This often occurs because of a server error from the robots.txt. Although this may have been caused by a temporary outage, we recommend making sure your robots.txt file is accessible and that your network and server are working correctly. Typically errors like this should be investigated and fixed by the site webmaster.
Technical SEO | | JasonTorney
my robts.txt also ok i checked it
Here is my website https://whiskcreative.com.au
just check it please as soon as possibe0 -
Any crawl issues with TLS 1.3?
Not a techie here...maybe this is to be expected, but ever since one of my client sites has switched to TLS 1.3, I've had a couple of crawl issues and other hiccups. First, I noticed that I can't use HTTPSTATUS.io any more...it renders an error message for URLs on the site in question. I wrote to their support desk and they said they haven't updated to 1.3 yet. Bummer, because I loved httpstatus.io's functionality, esp. getting bulk reports. Also, my Moz campaign crawls were failing. We are setting up a robots.txt directive to allow rogerbot (and the other bot), and will see if that works. These fails are consistent with the date we switched to 1.3, and some testing confirmed it. Anyone else seeing these types of issues, and can suggest any workarounds, solves, hacks to make my life easier? (including an alternative to httpstatus.io...I have and use screaming frog...not as slick, I'm afraid!) Do you think there was a configuration error with the client's TLS 1.3 upgrade, or maybe they're using a problematic/older version of 1.3?? Thanks -
Technical SEO | | TimDickey0 -
How do I get coupon information like retailmenot has on the SERPs?
Hello can anyone tell me how I can implement the same tactic that RetailMeNot is using to populate coupon information in the search results? They have below there meta description 4 fields labeled:Coupon Codes: 38, Free Shipping Deals: 6, Best Discount: 20% off, & Total Offers: 49 Is there some schema markup here? Or is this only allowed for RMN I have not seen it elsewhere but want my website coupons page to compete with them in the SERPs. Appreciate your help! dQNkHrb
Technical SEO | | Serenawong1 -
Robots.txt file getting a 500 error - is this a problem?
Hello all! While doing some routine health checks on a few of our client sites, I spotted that a new client of ours - who's website was not designed built by us - is returning a 500 internal server error when I try to look at the robots.txt file. As we don't host / maintain their site, I would have to go through their head office to get this changed, which isn't a problem but I just wanted to check whether this error will actually be having a negative effect on their site / whether there's a benefit to getting this changed? Thanks in advance!
Technical SEO | | themegroup0 -
Crawling image folders / crawl allowance
We recently removed /img and /imgp from our robots.txt file thus allowing googlebot to crawl our image folders. Not sure why we had these blocked in the first place, but we opened them up in response to an email from Google Product Search about not being able to crawl images - which can/has hurt our traffic from Google Shopping. My question is: will allowing Google to crawl our image files eat up our 'crawl allowance'? We wouldn't want Google to not crawl/index certain pages, and ding our organic traffic, because more of our allotted crawl bandwidth is getting chewed up crawling image files. Outside of the non-detailed crawl stat graphs from Webmaster Tools, what's the best way to check how frequently/ deeply our site is getting crawled? Thanks all!
Technical SEO | | evoNick0 -
How do I create a Video Sitemap for Youtube Embedded Videos?
I've been seeing a lot of people recommend creating a video sitemap or Media RSS feed (mRSS) and submit to Google. We have videos hosted on Brightcove and most on YouTube. Brightcove can generate the sitemap for us. But does anyone know how to generate a YouTube Video Sitemap for those videos embedded on our pages? Note: I realize I could manually assemble the video sitemap, however manually assembling the sitemap is probably not an option for us due to the volume of videos we've published.
Technical SEO | | LDS-SEO1