Lazy Loading of Blog Posts and Crawl Depths
-
Hi Moz Fans,
We are looking at our blog and improving the content as much as we can for SEO purposes, but we have hit a bit of a blank in terms of lazy loading implications and issues with crawl depths.
We introduced lazy loading onto the blog home page to increase site speed initially and it works well with infinite scroll, but we were wondering whether this would cause any issues regarding SEO.
A lot of the resources online seem to be conflicting and some are very outdated, so some clarification on what is best in terms of lazy loading and crawl depths for blogs, would be fantastic!
I hope someone can help and give us some up to date insights - If you need anymore information, I'll reply ASAP
-
This is fantastic - Thank you!
-
Lazy load and infinite scroll are absolutely not the same thing, as far as search crawlers are concerned.
Lazy-loaded content, if it exists in the dom of the page will be indexed but it's importance will likely be reduced (any content that requires user interaction to see is reduced in ranking value).
But because infinite scroll is unmanageable for the crawler (it's not going to stay on one page and keep crawling for hours as every blog post rolls into view) Google's John Mueller has said the crawler will simply stop at the bottom of the initial page load.
This webinar/discussion on crawl and rendering from just last week included G's John Mueller and a Google engineer and will give you exactly the info you're looking for, right from the horse's mouth, Victoria.
To consider though - the blog's index page shouldn't be the primary source for the blog's content anyway - the individual permalinked post URLs are what should be crawled and ranking for the individual post content. And the xml sitemap should be the primary source for google's discovery of those URLs. Though obviously linking from authoritative pages will help the posts, but that's going to change every time the blog index page updates anyway. Also, did you know that you can submit the blog's RSS feed as a sitemap in addition to the xml sitemap? It's the fastest way I've found of getting new blog posts crawled/indexed.
Hope that helps!
Paul
-
I'm afraid I don't have an insight into how Google crawls with lazy loading.
Which works better for your user, pagination or lazy loading? I wouldn't worry about lazy loading and Google. If you're worried about getting pages indexed then I would make sure you've got a sitemap that works correctly.
-
Great, thank you
Do you have any insight into crawl depth too?
At what point would Google stop crawling the page with lazy loading? Is it best to use pagination as opposed to infinite scroll? -
With lazy loading, the code can actually still be seen in the source code. That's what Google uses, so you should be fine with using this as it's becoming a common practice now.
-
Yes, it's similar to the BBC page and loads when it is needed by the user so to speak.
It increased the site loading, but do you know at what point Google would stop indexing the content on our site?
How do we ensure that the posts are being crawled and is pagination the best way to go?
-
I'd have to say, not too familiar with the method you are using, but I take it the idea is elements of the page load as you scroll like BBC?
If it decreases the load time of the site that is good for both direct and indirect SEO, But the key thing is can Google see the contents of the page or not? - Use Google Search Console and fetch the page to see if it contains the content.
Also, Google will not hang around on your site, if it doesn't serve the content within a reasonable amount of time it will bounce off to the next page, or the next site to crawl. It's harsh, but it's a fact.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Blog with all copied content, should it be rewritten?
Hi, I am auditing a blog where their goal is to get approved to on ad networks but the whole blog has copied content from different sources, so no ad network is approving them. Surprisingly (at least to me), is that the blog ranks really well for a few keywords (#1's and rich snippets ), has a few hundred of natural backlinks, DA is high, has never been penalized (they have always used canonical tags to the original content), traffic is a few thousand sessions a month with mostly 85% organic search, etc. overall Google likes it enough to show them high on search. So now the owner wants to monetize it. I suggested that the best approach was to rewrite their most visited articles and deleted the rest with 301 redirects to the posts that stay. But I actually haven't worked on a similar project before and can't find precise information online so I'm looking to know if anyone has a similar experience to this. A few of my questions are: If they rewrite most of the pages and delete the rest so there is no repeated/copied content, would ad networks (eg. adsense) approve them? Assuming the new articles are at least as good quality as the current ones but with original content, is there a risk on losing DA? since pretty much it will look like a new site once they are done They have thousands of articles but only about 200 hundred get most visits, which would be the ones getting rewritten, so it should be fine to redirect the deleted ones to the remaining? Thanks for any suggestions and/or tips on this 🙂
Intermediate & Advanced SEO | | ArturoES0 -
Blog on Custom Website - WordPress Alternatives
Howdy folks. I'm trying to find any good alternative for adding CMS blog to custom website. Most people, us included, are using WP, but, as we know, it's really painful to work with, easily hackable etc etc. So, I wonder if anyone knows of a blog platform, which can be installed on our own websites for blogging, but without drawbacks of WordPress. Any nudge in correct direction will be appreciated. Thanks!
Intermediate & Advanced SEO | | DmitriiK1 -
Yoast local landing...posts?
Hey Moz squad. I do some seo work for a multi location locksmith and garage door service. On our locksmith website - We just use regular word press landing pages for all of our different city cities. (btw if anyone has a good site architecture tips blog they know about, Send it my way!) So with our Garage door site, we bought the yoast local plugin. And it wants to make our locations Blog posts instead of pages. NOW what do you guys think. Does it matter? I know I have less control on how a blog post looks. But I'm just looking for different opinions. Thanks loves.
Intermediate & Advanced SEO | | Meier0 -
Wordpress to HubSpot CMS - I had major crawl issues post launch and now traffic is down 400%
Hi there good looking person! Our traffic went from 12k visitors in july to 3k visitors in july. << www.thedsmgroup.com >>When we moved our site from wordpress to the hubspot COS (their CMS system), I didnt submit a new sitemap to google webmaster tools. I didn't know that I had to... and to be honest, I've never submitted or re-submitted a sitemap to GWT. I have always built clean sites with fresh content and good internal linking and never worried about it. Yoast kind of took care of the rest, as all of my sites and our clients' sites were always on wordpress. Well, lesson learned. I got this message on June 27th in GWT_http://www.thedsmgroup.com/: Increase in not found errors__Google detected a significant increase in the number of URLs that return a 404 (Page Not Found) error. Investigating these errors and fixing them where appropriate ensures that Google can successfully crawl your site's pages._One month after our site launched we had 1,000 404s on our website. Ouch. Google thought we had a 1,200 page website with only 200 good pages and 1,000 error pages. Not very trust worthy... We never had a 404 ever before this, as we added a plugin to wordpress that would 301 any 404 to the homepage, so we never had a broken link on our site, which is not ideal for UX, but as far as google was concerned, our site was always clean. Obviously I have submitted a new sitemap to GWT a few weeks ago, and we are moving in the right direction... **but have I taken care of everything I need to? I'm not sure. Our traffic is still around 100 visitors per day, not 400 per day as it was before we launched the new site.**Thoughts?I'm not totally freaking out or anything, but a month ago we ranked #1 and #2 for "marketing agency nj", now we aren't in the top 100. I've never had a problem like this. _I added a few screen grabs from Google Webmaster Tools that should be helpful.__Bottom line, have I done everything I need to or do I need to do something with all of these "not found" error details that I have in GWT?_None of these "not found" pages have any value and I'm not sure how Google even found them... For example: http://www.thedsmgroup.com/supersize-page-test/screen-shot-2012-11-06-at-2-33-22-pmHelp! -JasonuhLLtou&h4QmGCW#0 uhLLtou&h4QmGCW#1
Intermediate & Advanced SEO | | Charlene-Wingfield0 -
Crawl diagnostic issue?
I'am sorry if my English isn't very good, but this is my problem at the moment: On two of my campagnes I get a weird error on Moz Analytics: 605 Page Banned by robots.txt, X-Robots-Tag HTTP Header, or Meta Robots Tag Moz Analytics points to an url that starts with: http:/**/None/**www.????.com. We don't understand how Moz indexed this non-existing page that starts with None? And how can we solve this error? I hope that someone can help me.
Intermediate & Advanced SEO | | nettt0 -
Leveraging interest on a popular blog post, with a new, expanded page on the subject...
On a wordpress site, I have one blog post that performs extremely well for Adsense revenue. But the post is getting older and older, and requires me to place some updates into the article from time to time. It's a blog post, but really feels like more of a reference types page (it's about stocks in a particular industry). Now that I see so many people landing on this page through search (#1 for the term), I'm thinking I really should really develop this information further, and make a reference page out of this information and keep it updated, with a link to it from the nav menu. However, I don't know if it will be bad to have both the reference page and the old post page trying to rank for the same keyword term or not? (They won't be duplicate content, the new page will just the same topic rewritten and expanded). Is that something I can get penalized for? I'm getting very good income off of this existing blog post and don't want to mess it up, but I also know that only keeping this info on a post that's getting older and older is not a good long term plan, and I need to pounce on the interest in the subject matter. So, I see these options: 1. Create the new expanded page, and let Google sort it in the SERPs. 2. Create the new page and redirect the old blog post to the new page. That just doesn't seem right to remove access to my old blog post, though. Which of these is the right thing to do, or is there some way I'm not thinking of?
Intermediate & Advanced SEO | | bizzer0 -
H1 or H2 for Post Title SEO
I know people suggest having a H1 with your keyword on your page somewhere to help with SEO. My current wordpress theme has the post title as a H2. Is there a big difference in using H1 vs H2
Intermediate & Advanced SEO | | DojoGuy0 -
Wordpress blog integration with full website effect on SEO
I have searched and searched for the answer to this question and can't find it. We are going to be launching a Wordpress blog on our domain shortly, however we have a much larger site that is mixed with static and dynamic pages full of custom programming tied to databases, etc. that we are running around the blog and can't integrate that into Wordpress due to its complexity. What this means is we have to install Wordpress on our servers somehow separate from the pages of our website. What I am wondering is if we run Wordpress in the /blog directory of our site as a separate installation if it will inherit the domain authority of our domain (currently around 60) or if it will be viewed as a separate site and get no ranking. Also, will our main site inherit the additional link juice from the inbound links that we get from the blog with it being separate from the main site? How does this need to be setup on our webservers to ensure the blog gets authority of the domain, and the blog contributes maximum SEO value to the domain? Any help would be appreciated.
Intermediate & Advanced SEO | | CodyWheeler0