Is real google bot like "fetch"or more like "fetch & render"?
-
In GWT we have two options to mimic googlebot visits, "fetch" and "fetch and render", but when the real googlebot visit a page, is he behaving like the former or the latter?
I can see fetch does fetch only the html, while fetch and render does fetch .js and .css as well.
But what does the real googlebot does?
I have checked the web server logs, and I can see the real googlebot sometimes request the .js files too, but not every time it visit a page, sometimes it does, sometimes it does not.
Has anyone figured out when googlebot actually request javascript files?
-
That was my guess, that google somehow cache the .js files, so I changed one javascript file name to a random generated name. Did it last night, I will recheck logs in a couple of days to see what happen.
-
Googlebot is behaving like the latter, "Googlebot constantly crawls and renders URLs across the entire web..." from https://support.google.com/webmasters/answer/6066467, but has the option of streamlining the process by not rendering every time. For example, if many sites are referencing the same centrally hosted code base of js, googlebot doesn't need to constantly recheck that js every time it comes across the link.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
A/B Testing Through Google Tag Manager
Hi I have just started working on Google Tag Manager and trying to implement all important tags through Tag Manager only. Can we also implement A/B Testing (Experiment in Analytics) through Google Tag manager.
Reporting & Analytics | | RuchiPardal0 -
How to exclude IP from Google Analytic?
Hello Guys, I am admin of google analytic, i am trying to exclude traffic in google analytic from admin, view section then filter but not there is no button of save? Can anyone please help me? PFA of image. zOkvX1n.jpg
Reporting & Analytics | | devdan0 -
How to filter many cities from Google analytics
I need to filter hundreds of cities from my traffic reports. I've been told that adding them all in this format: |Knutsford|Ripon|Cheadle Hulme|Congleton| and using the 'matching reg/exp from the drop down should do it... Unfortunately that doesn't seem to be working as I can still see cities like London in the results.... Any ideas?
Reporting & Analytics | | david.smith.segarra0 -
Google Analytics underreporting
I have a site selling items, I use paypal buttons and get a report using ipn back from paypal telling me when I have sold a item. I also have a Google analytics event setup on the button, and one on the confirmation page.
Reporting & Analytics | | AlanMosley
For example in the last few days I have sold over 10 items from the website, but have only 2 events from the button and none from the confirmation page. The confirmation page depends on the user getting redirected back from PayPal so I can see that being upper reported, but there is no way you can buy without clicking the button.
I have the chrome addon from google to debug your analytics code and it fires every time.
The figures seem to report only about 20% of events over a long period of time. If it was not working at all, I could assume I have not set things up correctly but this is not the case, I get a regular flow of events but at about 205 of sales.
I am very disappointed with GA, seems a waste of time. anyone else had the same expirence?0 -
Google Analytics for multiple languages on multiple domains
Hi folks A quick question in regards to setting up Google Analytics for a website with multiple languages on multiple domains. The domains that needs to be tracked are: www.example.com -> English www.example.se -> Swedish www.example.dk -> Danish To my best knowledge this can be acheived in Google Analytids using 3 different setups: Different accounts Different properties Profiles What would you guys consider the best approach?
Reporting & Analytics | | Resultify
Pros and cons? Have a great day Fredrik0 -
Google Analytics bug?
Hi, I'm getting hits to this page, it's screwing up my Google Analytics stats. I know it's related with Google Website Optimizer, cuz it correlates with the tests I ran at the same dates. I'm just wondering if you've seen this before and what I should do to clean my stats? And is this affecting my SEO? Because it's still registering hits to these pages but I already stopped the tests a while go. Should I disallow this in my robots.txt file? Thanks! ga_bug3.jpg
Reporting & Analytics | | rhenster990 -
Track banner ad with google analytics
Hi We have a top banner ad on an external renown site only to attrack traffic. It does show up in google analytics, but i have seen some increase in (direct) / (none) traffic. Is there anyway i can track it when banner is showed from 2 separate URLs http://www.tv2torget.no/bedrift/netthandel/ and http://www.tv2torget.no/bedrift/netthandel/barneklaer/ Thanks Dan Lærum
Reporting & Analytics | | danlae0 -
Not ranking in Google.com
I put up my last site on the web since a month. So far I have been optimizing mainly to Hungary and I got used to that my content was indexed in a day and if content was good it sometimes appeared in the first two pages in a couple of days. Now with my new site I am targeting google.com. I put it up since a week, sent the sitemap to google, it was intresting for mee te see that even the pages to get into the web index needed two days. Seomoz says my site is all right besides some duplicate content issue i will solve soon. So it is past a week and even if I copy a complete sentence from the beginning of my home page and paste it into google my site does not appear. I also purchased couple of backlins but they have not appeared so far as well. Is that really this slow? Am I to impatient? Or should there be something else problem I should be looking for? Thanks for any feedback
Reporting & Analytics | | sesertin0