Welcome to the Q&A Forum

Browse the forum for helpful insights and fresh discussions about all things SEO.

Your browser does not seem to support JavaScript. As a result, your viewing experience will be diminished, and you have been placed in read-only mode.

Please download a browser that supports JavaScript, or enable it if it's disabled (i.e. NoScript).

How I can check if Google and other search engines will properly cache a page (a dynamic one)?

Algorithm Updates

500

esiow2013 last edited by

My site is currently disallowing search engine bots with the help of robots.txt. These dynamic pages can be crawled using Screamingfrog since they are linked to a static category page which is also linked to the homepage.

Thanks in advance!
1 Reply Last reply
Reply Quote 0
danwebman last edited by

Great idea using Screaming Frog first then :-

Then use Google Web Master Tools > Crawl > Fetch as Google to see what Google sees
1 Reply Last reply
Reply Quote 1

Got a burning SEO question?

Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.

Start my free trial

Browse Questions

View

From

Sorted by

With category

Explore more categories

Related Questions

Confuse search engine result

When We check few keywords in Google.com from India, we can see these keywords perfectly listed in the first google search result pages. But when I checked these keywords in USA chorme, Mozilla, internet explorer Brower using one of our USA client pc using remote desktop, we really shocked that these keywords not listed in the USA country. Which means I am an Indian, if I check these keywords from India using google.com, I can see but if I check these keywords in USA country PC browser, I do not see. Please help us
Algorithm Updates | | Intellect

0
Issue with Category Ranking on Page 1 vs. Homepage Ranking on Page 2

A client has a high-volume keyword that is rendering different results, whether it is on page one or page two of Google SERPs. If the keyword is on page one, ONLY the category page is ranking. When the keyword bumps off to page two, BOTH the category AND the homepage are ranking. This is happening on our IP and theirs, incognito and personalized searches. This has been happening since February. Any thought/insights would be greatly appreciated, thank you!!!!
Algorithm Updates | | accpar

0
Google Index

Hi all, I just submit my url and linked pages along with xml map to index. How long does it take google to index my new pages?
Algorithm Updates | | businessowner

0
Home Page not ranking?

Hey guys, I'm working on a relatively new client and have noticed that all the initial rankings that we have point towards a sub page rather than the home page. Only a branded search appears to bring up the home page which seems really strange. Any ideas? Home page; www.geraldmiller.com Sub page (ranking); www.geraldmiller.com/dwi-dui-defense
Algorithm Updates | | Webrevolve

0
Google is forcing a 301 by truncating our URLs

Just recently we noticed that google has indexed truncated urls for many of our pages that get 301'd to the correct page. For example, we have:
http://www.eventective.com/USA/Massachusetts/Bedford/107/Doubletree-Hotel-Boston-Bedford-Glen.html as the url linked everywhere and that's the only version of that page that we use. Google somehow figured out that it would still go to the right place via 301 if they removed the html filename from the end, so they indexed just: http://www.eventective.com/USA/Massachusetts/Bedford/107/ The 301 is not new. It used to 404, but (probably 5 years ago) we saw a few links come in with the html file missing on similar urls so we decided to 301 them instead thinking it would be helpful. We've preferred the longer version because it has the name in it and users that pay attention to the url can feel more confident they are going to the right place. We've always used the full (longer) url and google used to index them all that way, but just recently we noticed about 1/2 of our urls have been converted to the shorter version in the SERPs. These shortened urls take the user to the right page via 301, so it isn't a case of the user landing in the wrong place, but over 100,000 301s may not be so good. You can look at: site:www.eventective.com/usa/massachusetts/bedford/ and you'll noticed all of the urls to businesses at the top of the listings go to the truncated version, but toward the bottom they have the full url. Can you explain to me why google would index a page that is 301'd to the right page and has been for years? I have a lot of thoughts on why they would do this and even more ideas on how we could build our urls better, but I'd really like to hear from some people that aren't quite as close to it as I am. One small detail that shouldn't affect this, but I'll mention it anyway, is that we have a mobile site with the same url pattern. http://m.eventective.com/USA/Massachusetts/Bedford/107/Doubletree-Hotel-Boston-Bedford-Glen.html We did not have the proper 301 in place on the m. site until the end of last week. I'm pretty sure it will be asked, so I'll also mention we have the rel=alternate/canonical set up between the www and m sites. I'm also interested in any thoughts on how this may affect rankings since we seem to have been hit by something toward the end of last week. Don't hesitate to mention anything else you see that may have triggered whatever may have hit us. Thank you,
Michael
Algorithm Updates | | mmac

0
How do search engines calculate ranking?

On SEOMoz, I can see that when people type in X keyword, my website comes up at Y place. For example, if someone googles "Mobile Productivity", a page on my website comes up at #10. How is that #10 ranking calculated? I would've guessed it's based on some combination of linking root domain and page authority, but I see sites that rank below mine that have higher scores on both. For example, on the aforementioned 'Mobile Productivity' search, my site comes up #10 with a Linking Root Domain score of 2, and a Page Authority of 29. But Honeywell Products and Services comes up #13 on the same "Mobile Productivity" search (ie, BELOW my site), even though they have a Linking Root Domain score of 40 and a Page Authority of 72. Similarly, Mobileproductivity.com comes in at #1 for that search with scores of 7 and 31 respectively, but mpifix.com comes in at #2 with scores of 61 and 47 respectively. How are the search engine rankings calculated? Thanks in advance, Julian
Algorithm Updates | | MobileDay

0
Not sure whether to update existing page or create a new one

Hello guys, So far I have found this Q&A to be very helpful. I have a couple of product pages on my website which rank very low in the search results. This was because in the past they were not at all optimized in terms of title, description, etc. I would like to now optimize these pages, get some inbound links to them, etc. I'm not sure whether to do this with the existing product pages or create new ones. I'm afraid that if I optimize the current pages, the low ranking from before will carry over. Would it be better to start fresh? Thank you, Pravin
Algorithm Updates | | goforgreen

0
What determines rankings in a site: search?

When I perform a "site:" search on my domains (without specifying a keyword) the top ranked results seem to be a mixture of sensible top-level index pages plus some very random articles. Is there any significance to what Google ranks highly in a site: search? There is some really unrepresentative content returned on page 1, including articles that get virtually no traffic. Is this seriously what Google considers our best or most typical content?
Algorithm Updates | | Dennis-52961

0