Table of Contents
Module 1: The Basic Principles of Evidence-Based Management ..........................................................3
Summarize the basic principles of evidence-based management......................................................3
What is Evidence-Based Management?..........................................................................................3
What counts as Evidence?..............................................................................................................4
When we say evidence, we basically mean information: facts or data supporting (or contradicting)
a claim, assumption, or hypothesis. It may be based on numbers, or it may be qualitative or
descriptive. Evidence may come from scientific research suggesting some relatively generalizable
facts about the world, people, or organizational practices. Evidence may also come from local
organizational or business indicators, such as company metrics or observations of practice
conditions. Even professional experience can be an important source of evidence, such as when an
entrepreneur learns from having launched a variety of businesses that one particular approach
seems more likely to pay off...............................................................................................................4
Explain the need for evidence-based management............................................................................4
Why do we need Evidence-based management?...........................................................................4
Identify the four sources of evidence, and provide examples of each................................................5
What sources of Evidence should be considered (1)?.....................................................................5
Before making an important decision, an evidence-based practitioner starts by asking, “What is
the available evidence?” Instead of basing a decision on personal judgment alone, an evidence-
based practitioner finds out what is known by looking for evidence from multiple sources.
According to the principles of evidence-based practice, evidence from four sources should be
taken into account:.........................................................................................................................5
What sources of Evidence should be considered (2)?.....................................................................8
Evaluate (coarsely and in general terms) the quality of evidence.......................................................9
Determine whether the best available evidence was used in a decision-making process................10
Why Focus on the Best Available Evidence?.................................................................................10
Correct common misconceptions about evidence-based management...........................................10
What Is the Evidence for Evidence-Based Management?.................................................................10
Summary..........................................................................................................................................11
Module 2: ASK Critical Questions about Problems and Solutions ........................................................12
Identify claims, assumptions, and hypotheses regarding a practical issue.......................................13
Determine what the (assumed) problem is for which the evidence should be consulted................14
Starting Point: What Is the Problem to Solve?..............................................................................14
PICOC............................................................................................................................................14
Overview of Questions.................................................................................................................16
Determine what the (assumed) problem is for which the evidence should be consulted................16
Step 1: What is the (assumed) problem to be solved?..................................................................16
1
, Formulate questions to determine whether the (assumed) problem is supported by evidence from
multiple sources...............................................................................................................................17
Step 2: What Is the Evidence for the Problem?............................................................................17
Determine what the preferred solution is for which the evidence should be consulted..................19
Step 3: What Is the Preferred Solution?........................................................................................19
Formulate questions to determine whether the preferred solution is supported by evidence from
multiple sources...............................................................................................................................20
Step 4: What Is the Evidence for the Solution?.............................................................................20
Developing Your Capacity to Ask Questions..................................................................................21
Summary..........................................................................................................................................22
Module 3: ACQUIRE Evidence from Practitioners ................................................................................24
Acquire evidence from practitioners in a valid and reliable way.......................................................24
What to ask...................................................................................................................................24
Whom to ask.................................................................................................................................25
How to ask....................................................................................................................................26
Developing Questions...................................................................................................................27
Summary..........................................................................................................................................28
Module 4: APPRAISE Evidence from Practitioners ...............................................................................29
Determine whether professional expertise is valid and reliable.......................................................30
What Constitutes Valid and Reliable Professional Expertise?.......................................................30
Identify/Recognize System 1 and System 2 thinking.........................................................................31
Two Modes of Thinking.................................................................................................................31
Cognitive Biases............................................................................................................................33
Identify common cognitive biases....................................................................................................33
Patternicity and the Illusion of Causality.......................................................................................33
Propose measures to overcome cognitive biases.............................................................................33
Confirmation Bias.........................................................................................................................33
Identify common cognitive biases + Propose measures to overcome cognitive biases....................35
Group Conformity.........................................................................................................................35
Other Common Cognitive Biases..................................................................................................35
Propose measures to overcome cognitive biases.............................................................................36
Avoiding or Reducing Bias.............................................................................................................36
Determine whether professional expertise is valid and reliable.......................................................38
Critically Appraising Evidence from Practitioners..........................................................................38
Overview of Appraisal Questions..................................................................................................39
Summary..........................................................................................................................................40
2
,Module 8: ACQUIRE Evidence from the Organization .........................................................................42
Acquire evidence from the organization in a valid and reliable way.................................................42
Why Is Evidence From The Organization Important?....................................................................42
From Data to Information to Evidence..........................................................................................42
What Questions To Ask?...............................................................................................................43
What Types Of Evidence Are Typically Available...........................................................................44
Big Data........................................................................................................................................45
Where To Find Organizational Evidence........................................................................................45
Techniques And Tools For Acquiring Data.....................................................................................47
Organizational Data Turned Into Information...............................................................................48
Some Final Considerations When Acquiring Data.........................................................................50
Summary..........................................................................................................................................51
Module 10: ACQUIRE - Evidence From Stakeholders ...........................................................................52
Acquire evidence from relevant stakeholders in a valid and reliable way.........................................52
Not All Evidence From Stakeholders Is Stakeholder Evidence.......................................................53
Types of Stakeholders...................................................................................................................54
Who are the most relevant stakeholders?....................................................................................55
Ethical considerations...................................................................................................................55
Whom to Ask?..............................................................................................................................56
Feelings And Perceptions: How To Ask?........................................................................................57
Summary..........................................................................................................................................59
Module 11: APPRAISE - Evidence From Stakeholders...........................................................................60
Assessing whether evidence from stakeholders is representative of the population from which it is
drawn................................................................................................................................................60
The importance of subjective feelings and perceptions................................................................60
What is the impact of the decision?.............................................................................................61
Representativeness.......................................................................................................................61
How representative is my sample?...............................................................................................62
Summary..........................................................................................................................................63
Module 1: The Basic Principles of
Evidence-Based Management
Summarize the basic principles of evidence-
based management.
What is Evidence-Based Management?
The basic idea of evidence-based management is that
sound quality decisions require both critical thinking and
use of the best available evidence. Of course, all
3
, practitioners use evidence in their decisions. But few pay attention to the quality of the evidence and
tend to base their decisions on only one source. The result is decisions that rely on unfounded beliefs,
fads and fashions, and the unsupported though popular ideas of management gurus. The bottom line is
bad decisions, poor outcomes, and little understanding of why things go wrong.
Evidence-based management seeks to improve the way decisions are made. It is an approach to
decision-making and day-to-day work practice that helps practitioners to critically evaluate the extent
to which they can trust the evidence they have at hand. It also helps practitioners identify and evaluate
additional evidence relevant to their decisions. In this course, we use the following definition of
evidence-based management. This definition is adapted in part from the Sicily statement of evidence-
based practice. [ 1] It not only provides a clear statement of what evidence-based management means
but also describes the main skills required to practice in an evidence-based way:
Evidence-based management is about making decisions through the conscientious, explicit, judicious
use of the best available evidence from multiple sources by…
ASKING: Translating a practical issue or problem into an answerable question
ACQUIRING: Systematically searching for and retrieving the evidence
APPRAISING: Critically judging the trustworthiness and relevance of the evidence
AGGREGATING: Weighing and pulling together the evidence
APPLYING: Incorporating the evidence into the decision-making process
ASSESSING: Evaluating the outcome of the decision taken
. . . to increase the likelihood of a favourable outcome.
What counts as Evidence?
When we say evidence, we basically mean information: facts or data supporting (or contradicting) a
claim, assumption, or hypothesis. It may be based on numbers, or it may be qualitative or descriptive.
Evidence may come from scientific research suggesting some relatively generalizable facts about the
world, people, or organizational practices. Evidence may also come from local organizational or
business indicators, such as company metrics or observations of practice conditions. Even professional
experience can be an important source of evidence, such as when an entrepreneur learns from having
launched a variety of businesses that one particular approach seems more likely to pay off.
Think of it in legal terms. In a court of law, evidence from many different sources is presented,
including eyewitness testimony, forensic evidence, security camera images, and witness statements.
All this evidence may help a judge or a jury to decide whether a person is innocent or guilty. The same
is true for management decisions. Regardless of its source, all evidence may be included if it is judged
to be trustworthy and relevant.
Explain the need for evidence-based management
Why do we need Evidence-based management?
Practitioners use many sources of evidence when making decisions, including intuition, personal
experience, knowledge acquired through formal education, insights provided by experts, advice
from a colleague, management literature, scientific research, and others.
Most management decisions are not based on the best available evidence. Instead, practitioners often
prefer to base decisions solely on their judgment derived from personal experience. However,
personal experience alone is not a reliable source of evidence because it is highly susceptible to
systematic errors. We have cognitive and information-processing limits that make us prone to biases
that have negative effects on the quality of the decisions we make.
4
The benefits of buying summaries with Stuvia:
Guaranteed quality through customer reviews
Stuvia customers have reviewed more than 700,000 summaries. This how you know that you are buying the best documents.
Quick and easy check-out
You can quickly pay through credit card or Stuvia-credit for the summaries. There is no membership needed.
Focus on what matters
Your fellow students write the study notes themselves, which is why the documents are always reliable and up-to-date. This ensures you quickly get to the core!
Frequently asked questions
What do I get when I buy this document?
You get a PDF, available immediately after your purchase. The purchased document is accessible anytime, anywhere and indefinitely through your profile.
Satisfaction guarantee: how does it work?
Our satisfaction guarantee ensures that you always find a study document that suits you well. You fill out a form, and our customer service team takes care of the rest.
Who am I buying these notes from?
Stuvia is a marketplace, so you are not buying this document from us, but from seller rosanscholten1. Stuvia facilitates payment to the seller.
Will I be stuck with a subscription?
No, you only buy these notes for $7.77. You're not tied to anything after your purchase.