Googlebot Visit Time & Date Stamps
-
I know that in Google Webmaster Central, we can see general Googlebot crawl stats based on dates. Our site is crawled daily.
We're trying to find out the time of day Googlebot visits our site - know of any ways to do this or tools out there?
-
You can use ApacheLogViewer(freeware) to view your web-server logs and filter where UserAgent="Googlebot". This will give you the raw statistics including time of day when Google crawled your site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Connect AMP to the same website GA property or not
Hi, Asking this on behalf of a client:"I know Google recommends setting up a separate GA property for AMP which they note in a few places:https://developers.google.com/analytics/devguides/collection/amp-analytics/https://support.google.com/analytics/answer/6343176?hl=en
Reporting & Analytics | | MediaCause
From what we can tell this is because the tracking for AMP will measure things differently than the current analytics.js library. I also think it's related to the GA cookie and how it's set differently for AMP pages.But won't this cause drop-off in user journey information? For example, if a user views an AMP blog article but then clicks to our site from a link within the article. I think we would then track this as two separate users and the pages/visit would be off. I found this article which explains a tech way to connect AMP to the same website GA property but it seems a little too much of a work-around:https://www.simoahava.com/analytics/google-analytics-client-id-amp-pages/ Do you think we should just do what Google recommends and set up AMP as a separate property in GA?" --> Does anyone know if there could be any issues with this workaround?Thanks,0 -
Canonical Tags & GWT Parameters
A site I'm working on has canonical tags which I find to be accurate, regardless of tracking parameters or anything else added to the url. The tag looks like: And we have alot of parameters in Google Search Console that look like Parameter Crawl page Let Googlebot Decide destination Let Googlebot Decide filters Let Googlebot Decide Since all of our parameters follow a question mark, like http://www.examplesite.com/questions/avocados?source=ad12345 and all of our pages have canonical tags showing the representative url without the additional parameters, why wouldn't we just have the one parameter in GWT as Parameter Crawl ? Representative URL I ask because I find that Google analytics shows pages with parameters as landing pages in search, which has me concerned about Google seeing it as duplicate content. Thanks! Best... Darcy
Reporting & Analytics | | 945010 -
Clarification on Analytics Goals & Funnel Logic
I have a few questions about funnel flow and how my goals are tracked. 1. My goal is a user completing a contact form, form.html. Upon completion, user is redirected to thanks.html, ending the flow. Every page header contains a direct link to form.html. Does this mean every page on my site is considered a "step" leading the user to the contact form? If so, do I list each page containing the form link in the steps, or only form.html? 2. If the above isn't correct, how do I track how the user wound up completing my form. I'd love to know which pages are performing better and leading to more sign-ups (goal completions). Currently I think I'd only be setup to know when a user is on the form.html page and whether they complete it or leave, not how they got to form.html in the first place. 3. My .html pages are actually embedded via iFrame on WordPress pages. My form.html page is hosted on .com/quote and upon completion, form.html redirects to thanks.html within the iFrame (.com/quote remains the actual page). I'd assume this is going to throw off my stats since the physical .html pages don't have Analytics code embedded? 4. How would I track different CTAs on the same page which lead to the same goal? For example, header vs. footer CTA's to the same sign-up sheet. Let me know if you need anything clarified. Thanks a lot for the help.
Reporting & Analytics | | kirmeliux0 -
Images Getting Indexed Making for Low Engagements Times in GA
I have quite a few images that are being indexed for popular search terms and are getting clicks. This site has a 0-10 second engagement of 69%. I would like to eliminate these images from the equation because I tend to think they are hurting my "quality score" in organic Google rankings. How do you keep these images from ranking? I suppose I could rename them. Should I disallow the images folder? I hate to do that, because some of my images turn up in local searches, which is good. I would rather keep those. But what is best practice? A little background info, this is a local service site. So the images that are ranking are coming up for a broad national type search. This has 0 value for the site. Any advice or suggestions would be appreciated, Thanks! Kathy
Reporting & Analytics | | MSWD0 -
Adwords Clicks correlating to Analytics Paid Visits
Would appreciate if anyone could clarify for me the correlation between 'clicks' in Google Adwords and visits for paid search in Google Analytics. Currently i see several thousand clicks a day in Adwords, yet our analytics account will only report a few hundred visits so i do not know which data set to use as the most reliable source for analysis. e.g 16th May. Analytics > TrafficSources > Sources > Search > Paid = 208 visits Adwords > All Campaigns, Total Clicks = 1153 i have found a few other questions asking the same thing here and here but dont feel they answer my question. We know our Adwords account is linked to our Analytics account as we got in touch with our PPC account manager originally about this and on reiew they found an error in our setup. Since then we know this is working as search terms and source are showing up and we have auto tagging enabled. Thanks, Tom.
Reporting & Analytics | | Sarbs0 -
Tracking page visits
Hi guys After a lot of effort and late nights our website has gone online. http://www.health2000.co.nz/ In google Analytics am I able to see what pages individuals clicked on before they went to the cart? Ive had a look at GA 'Flow Visualsiton' but it seems a little confusing. Thanks for your help Pete
Reporting & Analytics | | dawsonski0 -
Google Analytic Tracking Issue (&utm_nooverride=1)
Hello, We have a problem that means we are unable to track our AdWords and organic work at all. Looking at "/All Traffic Sources" and clicking on "Ecommerce Tab" in Analytics we can see that (made up ratio :)):
Reporting & Analytics | | jannkuzel
£2 is attributed to Google/ CPC
£1 is attributed to Google / Organic
But £100 to Payment Provider/ referral and also various referrals from banking transaction pages. All of the revenue/conversions are being credited to the payment provider or the bank security checks the payment goes through. After having done some research we have found that the problem may be that Google Analytics attributes the purchase to the most recent click (on the payment provider button) rather than the initial click on the cpc campaign/organic or direct etc. Some people have suggested using the "&utm_nooverride=1"
tag which we wanted to run past you guys and confirm whether adding
this tag to the payment provider 'buy now' button on our website will
presumably fix this referral problem? Alternatively does the tag need
to be entered into our CPC campaigns as well? Or can you please guide
us in another way? We have also heard that "cross-domain" tracking could be the solution. So we are really confused what to do and where hoping someone had maybe been through something similar and could advice before we fully launch into a solution. In addition, it should be noted that our 'Goals Funnel Visualisation'
of 'checkout' breaks up at the penultimate stage of the checkout. All
customers exit through the /checkout_process (penultimate) but are recognised returning to the successful checkout page but there is a missing link in between these
two stages as 0% pass through is shown even though they do return? Thank you so much in advance for all your help.0