How authentic is a dynamic footer from bots' perspective?
-
I have a very meta level question. Well, I was working on dynamic footer for the website: http://www.askme.com/, you can check the same in the footer. Now, if you refresh this page and check the content, you'll be able to see a different combination of the links in every section. I'm calling it a dynamic footer here, as the values are absolutely dynamic in this case.
**Why are we doing this? **For every section in the footer, we have X number of links, but we can show only 25 links in each section. Here, the value of X can be greater than 25 as well (let's say X=50). So, I'm randomizing the list of entries I have for a section and then picking 25 elements from it i.e random 25 elements from the list of entries every time you're refreshing the page.
Benefits from SEO perspective? This will help me exposing all the URLs to bots (in multiple crawls) and will add page freshness element as well.
**What's the problem, if it is? **I'm wondering how bots will treat this as, at any time bot might see us showing different content to bots and something else to users. Will bot consider this as cloaking (a black hat technique)? Or, bots won't consider it as a black hat technique as I'm refreshing the data every single time, even if its bot who's hitting me consecutively twice to understand what I'm doing.
-
Thank you so much Sir Alan. I really appreciate your efforts for compiling this detailed response to my questions. Have noted down all the points along with how better I can handle them, will soon come up with a better fat footer.
-
Nitin
You're dealing with multiple considerations and multiple issues in this setup.
First, it's a matter of link distribution. When you link to x pages from page 1, this informs search engines "we think these are important destination pages". If you change those links every day, or on every refresh, and if crawlers also encounter those changes, it's going to strain that communication.
This is something that happens naturally on news sites - news changes on a regular basis. So it's not completely invalid and alien to search algorithms to see or deal with. And thus it's not likely their systems would consider this black hat.
The scale and frequency of the changes is more of a concern because of that constantly changing link value distribution issue.
Either X cities are really "top" cities, or they are not.
Next, that link value distribution is further weakened by the volume of links. 25 links per section, three sections - that's 75 links. Added to the links at the top of the page, the "scrolling" links in the main content area of the home page, and the actual "footer" links (black background) so it dilutes link equity even further. (Think "going too thin" with too many links).
On category pages it's "only" 50 links in two sub-footer sections. Yet the total number of links even on a category page is a concern.
And on category pages, all those links dilute the primary focus of any main category page. If a category page is "Cell Phone Accessories in Bangalore", then all of those links in the "Top Cities" section dilute the location. All the links in the "Trending Searches" section dilute the non-geo focus.
What we end up with here then is an attempt to "link to all the things". This is never a best practice strategy.
Best practice strategies require a refined experience across the board. Consistency of signals, combined with not over-straining link equity distribution, and combined with refined, non-diluted topical focus are the best path to the most success long-term.
So in the example of where I said initially that news sites change the actual links shown when new news comes along, the best news sites do that while not constantly changing the primary categories featured, and where the overwhelming majority of links on a single category page are not diluted with lots of links to other categories. Consistency is critical.
SO - where any one or a handful of these issues might themselves not be a critical flaw scale big problem, the cumulative negative impact just harms the site's ability to communicate a quality consistent message.
The combined problem here then needs to be recognized as exponentially more problematic because of the scale of what you are doing across the entire site.
Got a burning SEO question?
Subscribe to Moz Pro to gain full access to Q&A, answer questions, and ask your own.
Browse Questions
Explore more categories
-
Moz Tools
Chat with the community about the Moz tools.
-
SEO Tactics
Discuss the SEO process with fellow marketers
-
Community
Discuss industry events, jobs, and news!
-
Digital Marketing
Chat about tactics outside of SEO
-
Research & Trends
Dive into research and trends in the search industry.
-
Support
Connect on product support and feature requests.
Related Questions
-
Silo architecture and PR dilution! What's real?
Hi all, Today I have gone through this "Silo" concept where we need to build 2nd hierarchy level pages and then lower hierarchy pages further to rank good for related terms of "keyword(s)". But I wonder, is it real? the so called Silo structure? Google may consider that we are trying trick if we create multiple pages (doorway pages) targeting same keyword. And one of my competitors is having too many 2nd hierarchy level pages against this Silo structure and even the homepage rank may dilute by contributing to the so many pages. But their web pages rank good for the keywords they chosen by creating multiple landing pages. These are contrary to each other. How it works in real? Thanks
White Hat / Black Hat SEO | | vtmoz0 -
What do you think of this "SEO software" that uses Rand's "proven method" ?
I saw an ad on Search Engine Roundtable and the call to action was... "What is the #1 metric that Google uses to rank websites?" I thought, "I gotta know that!". (I usually don't click ads but this one tempted me.) So I clicked in and saw a method "proven by Rand Fishkin" that will "boost the rankings of your website". This company has software that will use Rand's proven method (plus data from another unattributed test to boost the rankings of your website). I am not going to use this software. The video made my BS meter ring. But if you want to see it.... http://crowdsearch.me/special-backdoor/ Rather than use this "software", I would suggest using kickass title tags that deliver the searcher to kickass content. That has worked really well for me for years. Great title tags and great content will produce the same results. The bonus for you is that the great content will give you a real website.
White Hat / Black Hat SEO | | EGOL1 -
OSE report doesn't quite reflect the fact for me?
Hope someone could get me some insight if possible. We operate SEO purely on whitehat and for a popular keyword that we have worked hard for years now we ranks 10th. I have compared us with a few competitors who rank better (ranked 1st and 3rd) on OSE and found things confusing. In the following matrix we are way ahead of them in: Domain Authority
White Hat / Black Hat SEO | | LauraHT
Page Authority
Just-Discovered
root domain
total links
Social like/Social shares All score of above of our site are substantially higher than the competitors. one of the competitors has only one thing better than us:
Internal Equity-Passing Links plus It shows that both competitors have lots of low quality links as follow -forum signature anchor text links where the account no contribution to the forum
-low authority directories links where many of them are overseas and not industry specific
-links from article sites
-link from sites that are in totally different industries where we only have very a few or no from above I am thinking if the matrix figures from OSE dont count then what else I should be looking at. Any advice? please forgive me if I chose the wrong support question type.0 -
Google says 404s don't cause ranking drops, but what about a lot of them
Hello, According to Google here, 404s don't cause rankings to go down. Our rankings are going down and we have about 50 or so 404s (though some may have been deindexed by now). We have about 300 main products and 9000 pages in general on this Ecommerce site. There's no link equity gained by 301 redirecting the 404s. A custom 404 page has been made linking to the home page. There's nothing linking to the pages that are 404s Provided that no more 404s are created, can I just ignore them and find the real reason our rankings are going down?
White Hat / Black Hat SEO | | BobGW0 -
Advanced Outside Perspective Requested to Combat Negative SEO
**Situation: **We are a digital marketing agency that has been doing SEO for 6 years. For many years, we maintained exceptional rankings and online visibility.However, I suppose with great rankings comes great vulnerability. Last year, we became the target of a pretty aggressive and malicious negative SEO campaign from another other SEO(s) in our industry - I'm assuming they're competitors. Overnight, there were 10,000+ links built on various spam domains using the anchor text: negative marketing services poor seo butt crack kickass ... and more (see attached image) The issue we face are: Time Investment - Enormous investment of time and energy to contact each web admin for link removal. Hard to Keep Up - When we think we're getting somewhere, new links come out of the woodwork. Disavow Doesn't Work - Though we've tried to generally avoid the disavow tool, we've had to use it for a few domains. However, it's difficult to say how much effect, if any, it's had on the negative links. As you can imagine, we've seen an enormous drop in organic traffic since this all started. It's unfortunate that SEO has come to this point, but I still see a lot of value in what we do and hope that spammers don't completely ruin it for us one day. Moz Community - I come to you seeking some new insight, advice, similar experiences or anything else that may help! Are there any other agencies that have experienced the same issue? Any new ways to combat really aggressive negative SEO link building? Thanks everyone! UUPPplJ
White Hat / Black Hat SEO | | ByteLaunch0 -
How to run SEO tests you don't want to be associated with
A client has a competitor who is ranking above them for a highly competitive term they shouldn't really be able to rank for. I think I know how the site got there, and I think I can replicate it myself with a quick test, but it's definitely grey hat if not black hat to do so. I do not want my own sites and company to be damamged by the test, but i'd like to let the client know for sure, and also i'd love to know myself. The test should take about a week to run, there is no hacking involved or password stealing or anything damaging to another. How would you do such a test? I'm dubious about using my own server / site for it, but would a week really matter? Tom
White Hat / Black Hat SEO | | lethal0r0 -
Google turned me down, don't know why...
Hello, I'm experiencing decreasing on some of my keywords. I'm aware of some things which could be responsible for it. So I'd like to asi you, if my thoughts are right, and what to do with it. 1. I put backlinks leading onto my website. Those backlinks are on website I also own (they are on the same server). But nothing happened. Than I put other backlikns on this webiste. Those links also led to webistes I own. So could Google "punnished" those websites I'm linking to? 2. I offered my content to another website, which has a higher authority. This content had been published on my website weeks ago, I put it on this (another site). Co could Google punnished me for "duplicate" content? 3. In the past, we outsorced our SEO, and the company which was responsible for our SEO put backlinks leading to our website almost everywhere, I mean, those websites, they put links leading to our webistes fos focused on almost everything but our field (finance). But everything seemed to be fine, till now 4. Couple of days ago, I put our RSS on many RSS agregators and put our webiste on many catalogs. My website URL is www.penizenavic.cz Could you help me out? 🙂 Thanks a lot Petr
White Hat / Black Hat SEO | | petr.rozkosny0 -
What happened with Hayneedle's rankings?
Hayneedle is an e-commerce company that operates 200 niche sites selling indoor and outdoor home products. They were ranking at the top of the first page for most terms related to their sites (fire pits, fountains, benches, etc.), but all of a sudden at the end of April they lost their rankings, getting dropped to page 4 or lower for tons of their sites (barstools.com, patiofurnitureusa.com, adirondackchairs.com, benches.com, etc.). Does anybody know what caused this? Other than one thread on an SEO forum, we haven't been able to find any discussion about it online. It seems like cross-linking between the sites could have been a problem here, but we'd love to hear thoughts from the experts here on this. Our company is using the same business model of one brand with niche sites and we want to avoid anything like this happening to us.
White Hat / Black Hat SEO | | outdoorliving0