Our Foundation: Evidence-based Management
We work with insights from evidence-based management. AgilityVisual is based on years of research in the social sciences, paired with practitioners’ experiences and peer inputs.
Why Evidence-based Management?
High-quality decision-making matters in personal and professional life. In some situations, making the right or wrong decision has a direct impact on your opportunities, your standing, your outlook, and your future. In the late 90s, first guidelines on how to make decisions based on the best available evidence emerged in the healthcare sector. Evidence-based approaches quickly also became popular in law enforcement, public administration and across many areas of management. At AgilityVisual we believe that management tools that really make a difference have to rely on the best available evidence.
What is Evidence-based Management?
Evidence-based management refers to an approach that provides guidance on how to make better decisions. Being evidence-based means focusing on practices that have been tested in real-world situations and have been shown to work in meeting pre-defined quality standards. This makes “evidence” a better foundation for decision making than just relying on untested anecdotal experience, beliefs and other less rigorously tested sources such as business books, blogs or trainings.
How AgilityVisual relies on Evidence-based Management
We started by publishing Dossiers (in-depth articles) that summarize the state of the scientific literature on the challenges that arise in management, including challenges related to individuals and organizations. Each of these articles provide key take-aways and practices relevant to solving individual and organizational problems beyond the business realm.
Evidence-based Management is much more than aggregating scientific literature. This is why we developed AgilityVisual, a Business Performance Management Platform that addresses the most pressing leadership and management challenges from an Evidence-based Management point of view.
AgilityVisual relies on scientifically proven management tools and concepts like Situational Awareness, Goal Setting, Team Mental Model among others. As a consequence, AgilityVisual is a powerful tools to increase performance based the best available evidence.
Read More: The Evidence-Based Approach
Based on EBM principles, there are three main building blocks to be considered:
- Four sources of evidence
- Structured decision making process
- Evidence-quality criteria
There are four different sources of evidence that help you to make decisions on a sound evidence basis:
- Organizational data
- Professional expertise
- Stakeholder values and concerns
- Insights from scientific research
Considering this 360-degree spectrum of available evidence avoids missing important insights not yet on your radar and helps avoid relying on an incomplete picture when taking decisions. These four sources of evidence make sure that both contextual (e.g. organization-specific knowledge) and meta-knowledge (e.g. problem-specific knowledge) is considered. However, not all four sources of evidence are of the same quality. You need to select the best available evidence, which leads us to the next building block.
The second evidence-based management building block is a structured decision-making process similar to the “plan, do, check and act” cycle (PDCA-Cycle). The structured decision-making process starts with asking yourself: what needs to be achieved? Being aware of the current state and the desired future state before taking the decision is the very basis for step two: acquiring evidence. Once you have collected the evidence relevant to your particular challenge, you need to critically appraise it. This third step ensures that you only consider high quality evidence for your decision-making process. In terms of the PDCA-Cycle, these three steps can be summarized as “plan”.
After determining the key take-aways from the four sources of evidence, it is time to make your decisions and move your personal or professional project towards the desired future state. This fourth step reflects the “do” in the PDCA-Cycle. However, as we and our surroundings are embedded in a volatile, uncertain, complex and ambiguous (VUCA) environment, there is no 100% guarantee that your decision is sufficient to reach the desired future state. Hence, steps five and six are about analysing the outcomes of your decision on a regular basis and re-adjusting it with additional interventions, if necessary. In terms of the PDCA-Cycle, we are talking about “check” and “act”.
Management knowledge is not immune to the ongoing fake news and alternative facts discussion. To combat these pitfalls, it is vital to critically appraise the quality of evidence before using it in decision-making. However, how do you judge whether a piece of content should be considered as solid evidence or just another management fad designed to make you feel good? While there are no fool proof criteria that help you to make this distinction, there is a set of tools and guidelines you can consider. We will briefly address three of them and point to where you can get more information about evidence quality criteria.
Evidence hierarchies
Evidence hierarchies have been around for many years now and give a good appraisal of how solid a piece of evidence really is. On the top of evidence hierarchies , you will usually find meta-analysis and systematic reviews of randomized control trials (RCT) which represent the “gold standard” in quantitative research design. However, in management we deal with real life settings which makes is sometimes hard to apply lab trial results. At the other end of evidence hierarchies, you will usually find theoretical knowledge and case studies without much empirical evidence. Interestingly, surveys which are usually conducted at a certain point in time and (cross-sectional studies) are pretty low in the evidence hierarchy.
Reliability and validity
Reliability and validity are two of the most important quantitative research quality criteria. This makes them a must know for evidence-based management practitioners. In a nutshell, reliability refers to the consistency and reproducibility of results when measuring the same things – making sure that your tools are measuring what they say they are measuring not just once but a multiple times. Whether results accurately represent what they claim to represent is subject to the quality criteria assessing their validity.
Solidity rating
Solidity rating is a concept we developed to rate the state of the literature covering a specific business challenge in terms of evidence quality. It is based on five levels (from 0 to 5) and assigned to all our Dossiers. The idea behind the solidity rating is to provide management practitioners an immediate indication of the state of the literature underlying our Dossiers.
Management practitioners that follow an evidence-based management approach can expect numerous benefits. First and foremost, you will improve your decision-making quality which will add up to an increased organizational performance over time. The awareness that knowledge varies in quality and that there is no ‘silver bullet’ to solve business challenges will also make you a more critical consumer of the management literature. You will also learn more about the human and organizational factors behind a good place to work and a high-performance organization. This will also help you to manoeuvre your organization through challenging times when your leadership is needed more than ever.
While evidence-based management is associated with numerous benefits, there are also some shortcomings you should bear in mind. We will address four of them below, and suggest strategies on how to mitigate them.
Evidence is never complete
The body of evidence related to a specific business challenge is always an incomplete snapshot at any given point in time. As knowledge production progresses there will be new insights and the available body of evidence changes as well. Therefore, it is critical that you keep an eye on the latest developments in the body of evidence, ensuring relevance to the business challenges that are most important to you.
Evidence-based Management is inclined towards scientific methods
Evidence-based management strongly relies on scientific methods for knowledge production and research design. One could argue that this is a benefit rather than a shortcoming. The problem here can be that many scientific and academic studies are filled with statistics and dense data sets, making it difficult and time-consuming for practitioners to get to the practical application of their findings.
Quantitative research tends to be abstract and hard to apply in practice
Evidence-based management is rooted in the natural science paradigm which assumes that it is possible to derive (up to a certain extent generalized) conclusions about which management interventions work or don’t work. As a consequence, quantitative research findings tend to be abstract which makes them hard to apply in management practice. Depending on the business challenge you face, it can be beneficial to combine quantitative with qualitative research findings which tend to be much more context sensitive but can lack generalizability.
Evidence-based Management is time consuming
For busy management practitioners going through a structured decision-making process and screening the four sources of evidence requires a considerable time commitment. Over time you will find that practice makes perfect and the structured decision-making process will become the norm rather than the exception. AgilityVisual is a Business Performance Management Platform that relies on EBM insights and thus can help you to increase performance without going through the evidence-based management cycle every time you take decisions.