Does Google crawl and index dynamic pages?
-
I've linked a category page(static) to my homepage and linked a product page (dynamic page) to the category page. I tried to crawl my website using my homepage URL with the help of Screamingfrog while using Google Bot 2.1 as the user agent. Based on the results, it can crawl the product page which is a dynamic.
Here's a sample product page which is a dynamic page(we're using product IDs instead of keyword-rich URLs for consistency):http://domain.com/AB1234567
Here's a sample category page:
Here's my full question, does the spider result (from Screamingfrog) means Google will properly crawl and index the property pages though they are dynamic?
-
Andy's correct. The answer is most likely yes. So if screaming frog find these pages, most likely the Google bot will as well. Also, as long as the spider can find the page, it doesn't matter if it's static or dynamic. However, If you have multiple parameters, Google may decide it's not a useful page and won't index it. Make sure to include a sitemap with all these url's as it may help in getting them indexed in case your site architecture is poor.
-
For the most part, Google can find their way well around dynamic pages with few problems. There are always going to be exceptions, but this tends to be when there are lots of components to the URL structure.
As long as it is pretty simple, you shouldn't have any problems.
-Andy
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Does Google crawler understand & flag a blog post has text asserting sponsorship with dofollow outbound link?
I kind of know the answer, but just wanted to get some feedback from others. For the sake of argument, assume there are no other issues with the linking blog, such as: too many ads, thin content, etc. Question: If you make a payment for a blog post with a dofollow link, and in the blog post there is something to the effect of: "this post has been sponsored by..." Will Google crawlers detect that and flag that as an unnatural link?
White Hat / Black Hat SEO | | kekepeche0 -
What to do with internal spam url's google indexed?
I am in SEO for years but never met this problem. I have client who's web page was hacked and there was posted many, hundreds of links, These links has been indexed by google. Actually these links are not in comments but normal external urls's. See picture. What is the best way to remove them? use google disavow tool or just redirect them to some page? The web page is new, but ranks good on google and has domain authority 24. I think that these spam url's improved rankings too 🙂 What would be the best strategy to solve this. Thanks. k9Bviox
White Hat / Black Hat SEO | | AndrisZigurs0 -
I show different versions of the same page to the crawlers and users, but do not want to do anymore
Hello, While Google could not read JavaScript, I created two versions of the same page, one of them is for human and another is for Google. Now I do not want to serve different content to the search engine. But, I am worry if I will lose my traffic value. What is the best way to succeed it without loss? Can you help me?
White Hat / Black Hat SEO | | kipra0 -
Do industry partner links violate Google's policies?
We're in the process of The Great _Inquisition_piecing together a reconsideration request. In doing so, we reached out to an agency to filter and flag our backlinks as safe, should be no-followed, or should be removed. The problem is, they flagged several of our earned, industry partner links (like those pointing to us, HireAHelper, from 1-800-Pack-Rat and PODS for example) as either should be no-followed or should be removed. I have a hard time believing Google would penalize such a natural source of earned links, but then again, this is our second attempt at a Reconsideration Request, and I want to cover all my bases. What say you Moz community? No-follow? Remove? Leave alone?
White Hat / Black Hat SEO | | DanielH0 -
Do some sites get preference over others by Google just because? Grandfathered theory
So I have a theory that Google "grandfathers" in a handful of old websites from every niche and that no matter what the site does, it will always get the authority to rank high for the relevant keywords in the niche. I have a website in the crafts/cards/printables niche. One of my competitors is http://printable-cards.gotfreecards.com/ This site ranks for everything... http://www.semrush.com/info/gotfreecards.com+(by+organic) Yet, when I go to visit their site, I notice duplicate content all over the place (extremely thin content, if anything at all for some pages that rank for highly searched keywords), I see paginated pages that should be getting noindexed, bad URL structure and I see an overall unfriendly user experience. Also, the backlink profile isn't very impressive, as most of the good links are coming from their other site, www.got-free-ecards.com. Can someone tell me why this site is ranking for what it is other than the fact that it's around 5 years old and potentially has some type of preference from Google?
White Hat / Black Hat SEO | | WebServiceConsulting.com0 -
Is it outside of Google's search quality guidelines to use rel=author on the homepage?
I have recently seen a few competitors using rel=author to markup their homepage. I don't want to follow suit if it is outside of Google's search quality guidelines. But I've seen very little on this topic, so any advice would be helpful. Thanks!
White Hat / Black Hat SEO | | smilingbunny0 -
What on-page/site optimization techniques can I utilize to improve this site (http://www.paradisus.com/)?
I use a Search Engine Spider Simulator to analyze the homepage and I think my client is using black hat tactics such as cloaking. Am I right? Any recommendations on to improve the top navigation under Resorts pull down. Each of the 6 resorts listed are all part of the Paradisus brand, but each resort has their own sub domain.
White Hat / Black Hat SEO | | Melia0 -
Doorway Page? or just a flawed idea?
I have a website which is on a .co.uk TLD and is primarily focused to the UK. Understandably I get very little in the way on US traffic, even though a lot of the content is applicable to the UK or US and could be made more so with a little tinkering. The domain has some age to it and ranks quite well for a variety of keywords and phrases, so it seems sensible to keep the site on this domain. The .com version of the domain is no longer available, and the current owner does not seem inclined to sell it to me. So, I am considering registering a very similar .com domain and simply using it to drive some traffic to the .co.uk site. To do this, I would have the same category pages and the same (or similar) list of links to the various pages in those categories. But instead instead of linking to a page on the new .com, it would take visitors to the existing page on the .co.uk. I would make this transparent to visitors ("Take a look at these pages on our sister site bluewidgets.co.uk") and the .com would have some unique content of its own. Would this be considered some kind of Doorway site/page (content rich doorway), or is it simply bad idea which is unlikely to drive any traffic?
White Hat / Black Hat SEO | | Jingo010