Abstract
Aim:
This is Article 2 of a three-part series on clinical reasoning that encourages practitioners to explore and understand how they think and make case-based decisions. It is hoped that, in the process, they will learn to trust their intuition but, at the same time, put in place safeguards to diminish the impact of bias and misguided logic on their diagnostic decision-making.
Series outline:
Article 1, published in the January 2016 issue of JFMS, discussed the relative merits and shortcomings of System 1 thinking (immediate and unconscious) and System 2 thinking (effortful and analytical). This second article examines ways of managing cognitive error, particularly the negative impact of bias, when making a diagnosis. Article 3, to appear in the May 2016 issue, explores the use of heuristics (mental short cuts) and illness scripts in diagnostic reasoning.
Introduction
Making errors in veterinary practice is a constant source of irritation and disappointment. When cognitive errors happen, we feel we have let ourselves down. We also feel we have let down the patient and its owner. This is especially pertinent when it is not clear why a misdiagnosis was made, because we will be concerned that we may make the same mistake in the future. While this article cannot provide a single strategy for removing cognitive error from the diagnostic process, it can hopefully contribute by reducing the impact of such errors on clinical decision-making.
We will attempt to do this by asking you, the reader, to engage in metacognition (that is, to reflect on how you think about the diagnostic process) as we work through some case scenarios. These have been selected to emphasise cognitive error, especially that created through the use of bias. Many of the case scenarios are from our own personal experience, so we feel very qualified and not at all embarrassed (well, maybe a little!) in discussing what can go wrong when making a diagnosis. Before working through the case studies, we need to lay the groundwork for understanding the range of cognitive errors that might potentially occur in practice and to discuss those factors that predispose clinicians to such errors.
In Article 1 of this series, we introduced the relative merits and disadvantages of intuitive System 1 thinking (most commonly using pattern recognition) and System 2 thinking (a trained form of analytical, problem-oriented, data- or hypothesis-driven thinking) in diagnostic reasoning. 1 We have also introduced the concept of error when using one or both types of thinking to reach a diagnosis. Diagnostic error has been divided into (i) ‘no-fault’ error, due to an unusual presentation of the disease or deliberate or unknowing deception by the owner; (ii) system-related error, due to organisational or technical failures leading to lack of results, delayed results, or false or misleading results; and (iii) cognitive error (flawed clinical reasoning), due to faulty knowledge, data gathering or synthesis. 2
In human medicine, cognitive error is generally recognised as being the most common factor in getting the diagnosis wrong. It is likely that this is also the case in veterinary medicine (however tempting it might be to blame the laboratory for misleading you!). In Article 1 we suggested that cognitive error is more likely to occur when engaging in System 1 thinking, rather than System 2 thinking, because of greater use of bias, the influence of affective states, and a lack of conscious safeguards against error. We still hold to that view, but we should qualify it by stating that System 2 thinking has its own set of biases to contend with and manage. Moreover, there is the potential for poorly understood inbuilt (‘hardware’ issue) cognitive error unrelated to tiredness, stress or emotion when using both systems of thinking. If one accepts these generalisations, then the obvious question is: ‘what can be done to diminish cognitive error in diagnostic reasoning, irrespective of the system of thinking employed?’
The first step towards minimising cognitive errors is to try to understand why they occur. The second step is to develop strategies to reduce the likelihood of them occurring. Of course, our current knowledge of why some cognitive errors occur is incomplete, so the presented general strategies cannot provide a panacea; but they should, if used appropriately, help diminish cognitive error in clinical reasoning. This is, in a nutshell, the basis for this article: to better recognise when you are being led astray; what you can do to get back on the right track; and how to try to avoid repeating the mistake in the future.
What is cognitive error and why might it occur?
Erring in clinical reasoning is well accepted by the medical fraternity and has led to analysis of why it occurs. 3 While not all the factors contributing to cognitive error in medical clinical diagnosis have been delineated, it is highly likely that many apply equally to cognitive error in veterinary diagnosis. Flawed or misleading thinking strikes us all, especially towards the end of a long day filled with difficult conversations and many disappointments. Sometimes it strikes when we are feeling a little smug after a brilliant diagnosis. More commonly, it happens when we are feeling unsure due to a personal crisis (maybe a difficult surgery looming or a procedure that didn’t go well, or a letter of complaint from a client). What is probably harder to accept and manage is when the diagnosis goes wrong and we are feeling relaxed and apparently in good form. This last situation, which has happened to all the authors, highlights the lack of understanding of factors causing errors in thinking. This review acknowledges that ignorance and mindfully focuses on those factors known to contribute to cognitive error. For example, since personality, past experiences and present mood can influence the system of thinking utilised to reach a diagnosis, it follows that they may contribute to some errors in the reasoning process. It has been suggested that affective states, such as mood and sentiments, can influence and sometimes flaw both detection (sensory and other forms of perception) and, possibly more so, abductive and deductive reasoning during decision-making in any arena. 4
Cognitive error, as an inherent weakness in the scientific process, was perhaps best expressed by Sir Francis Bacon, a disgraced, corrupt politician who suddenly found that he had plenty of time on his hands to pursue his interest in experimental science. His treatise, which he called Novum Organum (Part 1 – Science or ‘True Suggestions for the Interpretation of Nature’), 5 established the basis for the fundamental approach to modern inductive scientific investigation. In it, Bacon outlined four ‘idols of the mind’, which were capable of generating false notions in scientific investigation. ‘Idols of the Tribe’ relate to deceptive reasoning common to the human race (a ‘hardware’ issue, as mentioned earlier, and which can affect both System 1 and System 2 thinking). ‘Idols of the Cave’ are aspects of deceptive reasoning specific to individuals (a ‘software issue’ related to the influence of one’s past experiences, personality and present mood). ‘Idols of the Marketplace’ relate to reasoning errors based on the written or spoken word, which may deliberately or inadvertently mislead the reader or listener. Finally, ‘Idols of the Theatre’ refer to the perpetuation of misleading ideas by learned groups (dogma perpetuated by experts of the time).
All these ‘idols’ are as relevant today as 400 years ago. This suggests that while there has been dramatic technological advancement in society, little has changed about the way we think when making decisions. Moreover, because the idols relate to reasons for cognitive error, they apply to faulty clinical reasoning irrespective of whether it primarily employs intuitive pattern recognition or a more effortful analytical, data-driven approach. For example, how many of you were given an idea or approach to diagnosis for a particular disease at university or at a conference by a highly respected colleague and utilised it in intuitive System 1 or analytical System 2 thinking for cases before realising, months or perhaps even years later, that it had misled you? One of us (PJC) has had that experience and had to review a number of similar cases over a 5 year period as a consequence. This related to being misguided on some key histopathological features used to distinguish between severe inflammatory bowel disease and diffuse small cell malignant lymphoma. Thankfully, while the diagnosis had to be adjusted for some cases, treatment and outcome were not greatly affected for all the cases. It seems it doesn’t matter how well trained we are, we probably all harbour ‘urban myths’ about disease that have been implanted by articles or presentations.
Article 1, on types of clinical reasoning, discussed emotion as being one factor that may lead to cognitive error because of its attachment with some long-term memories. 6 How does this relate to the situation in veterinary practice? Some types of cognitive error are a price we pay for experiencing rapid emotional responses to sensory information related to a case. Much of the time an emotional response in decision-making can be very useful (eg, do I need to calm this anxious client?). But it also has the potential to mislead when making complex decisions about disease causation. This is because emotion can not only influence memory usage but it can also directly affect clinical reasoning in both systems of thinking. That said, emotion does not seem to play a role in many forms of cognitive error. Rather it is factual information related to perception, as opposed to emotion, that can often provide powerful triggers for the retrieval of useful memories related to past cases, either as instance or generic illness scripts.
Bias – friend or foe?
There are many publications on cognitive error in clinical diagnosis in medicine, most focusing on when bias misleads.1,7,8 Bias is defined as possessing a predisposition or prejudice. It has been suggested that forms of cognitive bias exist in both System 1 and System 2 thinking for veterinary diagnosis, but that bias leading to cognitive error has a greater impact on System 1. 9 Numerous biases affect the process of diagnosis. An explanation of the more common ones, and examples of when they may come into play and mislead in veterinary practice, are given in Table 1. The information provided in Table 1 is the crux of this article. We urge you to work your way carefully through the table, and we hope you will find it rewarding.
Common biases utilised in clinical reasoning and examples of how they sometimes cause cognitive error (continued on page 243)
Note that biases don’t necessarily (in fact, rarely) operate in isolation. A variety of cognitive errors may confound any one case, due to the involvement of multiple biases
While it is certainly true that cognitive bias can mislead or misguide, more often the bias can actually be useful in the diagnostic process. Cognitive bias can save a busy practitioner a significant amount of time as it can focus the mind about a possible diagnosis (‘the nose for the story’). 10 In other words, biases can provide short cuts for thinking about a diagnosis (Article 3 will explore this further). It is accepted that some cognitive biases can facilitate fast and correct diagnoses in veterinary practice. 11
Of course, it is the potential for biases inherent in System 1 thinking to mislead that is our focus here. Since they act at the level of our subconscious, we are not aware of their action when we are carrying out diagnostic reasoning. However, knowing that these biases exist and cause potential for error, allows us to use trained System 2 thinking to apply some general measures to reduce their misleading effects – which is where this article is now heading. We should probably first remind you that System 2 thinking has its own set of biases that need to be managed when managing System 1 biases that have led to cognitive error!
Clearly life wasn’t meant to be easy, but we hope that it can be made a little more straightforward with the following discussion of general strategies for managing bias in clinical reasoning.
Strategies to manage bias and harness its power in clinical diagnosis
Sherlock Holmes had a knack for expressing his understanding of how his mind worked when solving a problem (see box). And even the great man himself understood that thinking can go awry! Moreover, he advocated the first rule of managing cognitive bias when it misleads: recognition.
Having catalogued some of the more common cognitive biases and suggested some mechanisms by which they may give rise to error when thinking about a clinical problem (see Table 1), we can now focus on strategies to manage some of the more common cognitive errors in clinical reasoning (see Table 2). While bias cannot, and probably should not, be eliminated from thinking, its capacity to mislead can be diminished in intensity and frequency, and sometimes repaired. Additionally, safeguards can be put into place to ensure that cognitive error through the use of bias has less impact the next time it strikes.
Suggested metacognitive strategies for managing cognitive error in clinical reasoning
Individual countries may also impose formal accountability schemes, such as clinical audits, to ensure standards are maintained. In the UK, for example, the Royal College of Veterinary Surgeons (RCVS) sets standards through a Guide to Professional Conduct. The RCVS also runs a voluntary Practice Standards Scheme, which sets a higher bar for veterinary practices
Post-mortem examination represents the ultimate form of feedback, and should be encouraged in cases where there is doubt about correct diagnosis in difficult cases that end badly
Since the 1970s, psychological research has focused on cognitive fallibility, with work on biases and heuristics leading to a shared Nobel Prize in 2002 for Daniel Kahneman. 12 Research on managing error through bias is less common, so it is much easier for us to try to summarise that information for you. In 1990, Gideon Keren coined the phrase ‘cognitive pills for cognitive ills’. 13 He was writing about whether ‘debiasing’ methods and aids are effective in reducing error (hence the real clause is ‘can cognitive pills cure cognitive ills?’). Since that time, metacognitive ‘debiasing’ strategies have become important for the medical fraternity, where misdiagnoses due to the use of cognitive bias have led to angst for physicians, novices and experts alike.7,8,14 –18
Strategies to manage error caused by the use of bias are scant in the veterinary literature but in a 2013 paper for veterinary educators, Professor Stephen May, of the Royal Veterinary College in the UK, suggests that these strategies need to be developed and introduced as early as possible for veterinary undergraduates. 9
What can the veterinary practitioner do to combat error related to bias?
The first strategy is to be aware of the existence of bias and to accept that it may affect your diagnostic reasoning. This may seem obvious, but it requires effort as it is trained System 2 thinking. Of course, some of us might not perceive bias as relevant to the way that we make decisions. 19 Other impediments to accepting the need for general debiasing strategies include strong emotional (affective) objections, personality and cultural influences. 19 For example, many Euro-American cultures are likely to engage in confirmation bias (Figure 1) and, therefore, resist confirmation debiasing; while many Asian cultures, because of their capacity to hold seemingly contradictory views simultaneously, are less likely to engage in confirmation bias and more accepting of the need to combat its potential harmful effects in decision-making. 20

When confirmation bias in diagnosis (or should that be overconfidence bias?) moves to a higher level!
Let’s assume that after reading this article you understand bias and how it may give rise to cognitive error in your diagnostic reasoning. What is the next step to manage its impact? Well, since bias can negatively affect System 1 thinking or untrained System 2 thinking (confirmation bias occurs largely in untrained System 2 thinking), it seems logical to engage in trained System 2 thinking to manage any misleading influence of bias. So, if you become aware that you have come to a presumptive diagnosis by intuition, or have even utilised some untrained System 2 thinking to follow up a presumptive diagnosis, force yourself to consider two groups of questions:
Asking yourself the second question (what alternative diagnoses are possible?) can make you more forceful in combating error through the use of biases. This is supported by research published in the 1980s, when terms such as ‘consider-the-opposite’ and ‘consider-an-alternative’ were used to describe this ‘debiasing’ strategy.21,22 However, close to a century beforehand Sherlock Holmes knew the power of looking for alternatives (see box below).
You will notice that these questions also include the four cornerstones of ‘good science’; namely, objectivity, accuracy, open-mindedness and scepticism. The last two, in particular, will stand you in good stead in accepting that there is always some uncertainty about formulating a diagnosis and deciding upon a level of probability with respect to diagnostic accuracy that is sufficient to feel comfortable in proceeding with treatment. Remember, a long-term favourable response to therapy often provides further evidence that a presumptive diagnosis is correct. In essence, by accepting uncertainty about the diagnostic process (no test will give you 100% certainty about a diagnosis – not even necropsy!) you can combat error related to the use of bias, particularly confirmation or overconfidence bias. Such an approach seems to have currency in other disciplines; in meteorology, for example, it is now common to predict a certain rainfall, and also the probability of that rainfall.
A willingness to engage in trained System 2 thinking to support System 1 thinking will help diminish any negative impact of bias, thus leading to a higher probability of diagnostic accuracy. 23 The old adage ‘practice makes perfect’ can perhaps be adapted to ‘practice at using trained System 2 thinking to support and manage System 1 thinking leads to better understanding about the power of both’. At first, the deliberate checking of your intuitive thought processes with System 2 thinking will slow down the diagnostic process, but time delays diminish with practice and experience. Not that slowing down clinical reasoning is always a bad thing! It may be viewed as detrimental for the ‘cash register’, and when you want to get home for dinner but have a waiting room full of clients. But slowing down the decision-making process is an accepted strategy for diminishing any negative impact of bias (Table 2).18,19
Of course, slowing down as a strategy to combat cognitive error must be utilised appropriately and requires the practitioner to recognise and select the difficult cases where this approach is justified. Creating review time might involve setting aside a period of reflection on problem cases or perhaps, if working in a group practice, a session of discussion with trusted and supportive colleagues about challenging or enigmatic cases. Some practices will use a visiting internal medicine or imaging specialist as a sounding board for such case discussions. Indeed, this is why teaching hospitals have grand rounds. However, don’t expect this to work for every case, as even collective decision-making is prone to bias (as discussed, it may lead to error through the shared information bias and possibly hindsight bias).
Finally, strategies to combat cognitive error in clinical reasoning should always include accountability (checks and balances). This may be through personal accountability, by setting aside time to research difficult or confusing cases (using textbooks and medical databases) and by ensuring that client feedback occurs for random ‘easy’ cases and for most cases that you found difficult to diagnose. Additionally – and perhaps a little more daunting – you may be able to persuade supportive colleagues to scrutinise and review some of your cases and provide feedback on your reasoning. This is unlikely to identify all cognitive errors, but some that you have not thought of may become evident and a plan can be designed to try to avoid that type of thinking in future cases.
Accountability and reflection can generate valuable checklists for difficult cases or for times when you are just having an ‘off day’. 24
Final comments
The general strategies outlined in this article will not always prevent cognitive errors in diagnosis, but we hope that through increased awareness you will diminish your error rate. Of course, it is up to you how you implement these strategies. Perhaps you have additional strategies in mind? We would love to hear what they are! We do encourage you to be brave, however, and at least try one or two strategies to combat the ‘dark side’ of bias.
We leave the last word to Sherlock Holmes: ‘There is nothing more stimulating than a case where everything goes against you.’ – Sir Arthur Conan Doyle (The Hound of the Baskervilles).
Supplemental Material
Click here for Supplementary Video
Richard Malik interviews Paul Canfield, lead author of the JFMS clinical reasoning series. To access this video, please visit: https://player-vimeo-com-s.web.bisu.edu.cn/video/150981038
Footnotes
Acknowledgements
Richard Malik is supported by the Valentine Charlton Bequest administered by the Centre for Veterinary Education of the University of Sydney.
Funding
The authors received no financial support for the research, authorship and/or publication of this article.
Conflict of interest
The authors declared no potential conflicts of interest with respect to the research, authorship and/or publication of this article.
References
Supplementary Material
Please find the following supplemental material available below.
For Open Access articles published under a Creative Commons License, all supplemental material carries the same license as the article it is associated with.
For non-Open Access articles published, all supplemental material carries a non-exclusive license, and permission requests for re-use of supplemental material or any part of supplemental material shall be sent directly to the copyright owner as specified in the copyright notice associated with the article.
