1.1 Cognitive Biases and Fallacies

In everyday life and in science, we make arguments and decisions based on information we receive. However, our brains can sometimes take shortcuts that lead us to illogical conclusions. This topic introduces the common patterns of flawed thinking (cognitive biases) and faulty arguments (logical fallacies) that can hinder sound scientific reasoning in physical sciences.

Definition

Cognitive Bias: A cognitive bias is the tendency to make decisions or behave illogically because of our values, memory, socialization, and other personal characteristics. In other words, it is a certain pattern of thinking based on how our brain works.

Logical Fallacies: Logical fallacies refer to the way we currently make claims and construct our arguments. These are claims that sound convincing at first but can be refuted by logical reasoning.

Core Concept

The human mind often uses mental shortcuts (heuristics) to process information quickly. While useful for daily life, these shortcuts can introduce errors in scientific reasoning. Cognitive biases are the internal tendencies that distort our thinking, while logical fallacies are the external flaws in the arguments we build. To think like a scientist, one must be able to recognize both in oneself and in the claims of others.

Detailed Explanation of Common Biases and Fallacies

The textbook identifies twelve specific patterns that hinder sound scientific reasoning. Each is explained below:

• What it is: The tendency of people to process information by searching for or interpreting information that is consistent with their existing beliefs. This biased approach to decision-making is largely unintentional and results in the individual ignoring information that contradicts their beliefs.
• Why it matters in science: A scientist might only look for data that supports their hypothesis and overlook or dismiss data that doesn't, leading to a flawed conclusion.

• What it is: A claim made on the basis of insufficient evidence. Instead of examining examples and evidence that are much more representative of a typical or average situation, you are using a small, unrepresentative sample to draw a conclusion about a large population.
• Why it matters in science: Concluding that a new catalyst is highly effective after testing it only once or twice is a hasty generalization.

• What it is: A false cause fallacy happens when an individual wrongly believes that there's a cause-and-effect connection between two objects or happenings. This fallacy assumes that if one event occurs after another, the first must be the cause of the second.
• Why it matters in science: It can mislead scientists into false causal relationships, such as assuming a reaction happened because a certain gas was added, simply because the gas was added just before the reaction started.

• What it is: This fallacy occurs when someone distorts or exaggerates another's claim and then attacks the distorted version of the claim instead of refuting the original claim.
• Why it matters in science: In a scientific debate, one might misrepresent a colleague's theory to make it easier to disprove, avoiding the real scientific question.

• What it is: Altering the criteria for success or acceptance of a theory once it has been achieved.
• Why it matters in science: This can hinder scientific advancement by establishing unrealistic expectations for proof, like changing the required accuracy of an experiment after the results are in.

• What it is: Believing something is true or superior just because it's a traditional practice or has been done that manner for a long time.
• Why it matters in science: This mindset can hinder the acceptance of fresh approaches or concepts that might be more precise or effective, like a scientist insisting on an old, less accurate measurement technique.

• What it is: An informal logical error or a convincing method where it's taken for granted that the views of a well-known authority in one field should be followed in another field.
• Why it matters in science: This could lead to the acceptance of incorrect theories based on an expert's general prestige rather than their specific knowledge, like accepting a physicist's claim about a biological process.

• What it is: The principle of Occam's razor, suggested by a 14th-century monk, states that if there are two possible explanations for the same event, you should choose the more straightforward one. This fallacy involves failing to apply this principle.
• Why it matters in science: Scientists might overcomplicate an explanation when a much simpler one exists.

• What it is: Proposing a hypothesis that cannot be verified or disproven.
• Why it matters in science: This is a major problem in the physical sciences because it weakens the foundation of scientific investigation based on evidence. If a hypothesis can't be tested, it's not scientifically useful.

• What it is: The less common but more precise definition is "to overlook a question, presuming it has been previously addressed." The actual meaning is "assume the conclusion."
• Why it matters in science: In scientific reasoning, this fallacy can result in circular arguments that do not advance understanding, where the proof for an idea is just the idea itself.

• What it is: Excluding evidence that could disprove a hypothesis.
• Why it matters in science: This can severely skew scientific research by ignoring contradictory data, which is essential for testing the validity of an idea.

• What it is: This error is based on the idea that if two objects share similarities in one or more aspects, they must also share similarities in another aspect.
• Why it matters in science: This can result in wrong deductions if the comparison doesn't prove valid when examined closely, like assuming that because two atoms have similar sizes, they must also have the same chemical reactivity.

Intermediate Level

These biases and fallacies are not just simple mistakes; they are systematic patterns of error. Cognitive biases are often unconscious and relate to how we perceive and interpret the world (e.g., ignoring data that contradicts our hypothesis). Logical fallacies are flaws in the structure of our arguments (e.g., attacking a distorted version of an opponent's idea). A key skill in scientific reasoning is metacognition—thinking about your own thinking—to recognize when you might be falling prey to one of these patterns. For example, if you find yourself dismissing data that challenges your theory, you should ask yourself: "Am I falling for confirmation bias?"

Important Points

• - Cognitive Biases are internal, psychological tendencies that affect our judgment.
• - Logical Fallacies are external, structural flaws in arguments.
• - Confirmation Bias is one of the most common and dangerous biases in science.
• - False Cause (Post Hoc) can easily trick you when observing events that happen in sequence.
• - A hypothesis that cannot be tested (non-testable hypothesis) is not useful for science.
• - Appeal to Tradition and False Authority are fallacies of weak justification.
• - Using a Straw Man is a dishonest way to argue.
• - Hasty Generalization is drawing a big conclusion from a small amount of data.

Remember

• - Bias is in your head; a Fallacy is in your argument.
• - Always ask: "Does this argument hold up to logic?"
• - Always ask yourself: "Am I ignoring any contradictory evidence?" to counter confirmation bias.
• - Correlation (two things happening together) does not mean causation (one causing the other).
• - A scientific claim must be testable to be valid.

Common Mistakes

• - Confusing a bias with a fallacy. A bias is a tendency in thought; a fallacy is a flaw in the argument itself. You can have a bias that leads you to commit a fallacy.
• - Thinking that every argument is a fallacy. Sometimes a statement is just wrong, but it is not necessarily a specific, named logical fallacy. The goal is to identify the structure of the bad reasoning.
• - Using "post hoc" incorrectly. Just because two events happen in order does not mean they are unrelated, but you cannot assume causation without further evidence.
• - Believing that an authority figure can't be wrong. They can be. An expert in one field is not an expert in all fields.

Quick Revision

This topic covers common errors in scientific reasoning. Cognitive biases, like confirmation bias, are patterns of thought that lead to illogical decisions. Logical fallacies, like hasty generalization or false cause, are flaws in the arguments we construct. Other key errors include the straw man fallacy (distorting an argument), appeal to tradition (believing something is true because it's old), and false authority (trusting an expert outside their field). Scientific thinking requires recognizing and avoiding these pitfalls to ensure conclusions are based on sound logic and all available evidence.

60-Second Revision

Cognitive biases (like confirmation bias) are internal thinking errors. Logical fallacies (like post hoc or straw man) are flaws in arguments. Key errors to avoid in science include drawing conclusions from insufficient evidence (hasty generalization) and proposing ideas that cannot be tested. Always check for these traps in your own thinking and in the claims of others.

Frequently Asked Questions (FAQs)

Q1. What is cognitive bias? Answer: Cognitive bias is the tendency to make decisions or behave illogically because of our values, memory, socialization, and other personal characteristics. It is a pattern of thinking based on how our brain works.

Q2. What is a false cause fallacy? Answer: The false cause fallacy (Post Hoc Ergo Propter Hoc) happens when an individual wrongly believes there is a cause-and-effect connection between two events simply because one happened before the other. It wrongly assumes that if one event occurs after another, the first must have caused the second.

Q3. Describe the straw man fallacy. Answer: The straw man fallacy occurs when someone distorts or exaggerates another's claim and then attacks the distorted version of the claim instead of the original one. It's a way of making an opposing argument easier to defeat.

Q4. What does the fallacy of exclusion involve? Answer: The fallacy of exclusion involves excluding evidence that could disprove a hypothesis. This can severely skew scientific research by ignoring contradictory data.

Q5. Give an example of a faulty analogy. Answer: A faulty analogy assumes that if two things are alike in some ways, they must be alike in other ways too. For example, "Atoms are like tiny solar systems, so electrons must orbit the nucleus in the same way planets orbit the sun." This is a flawed comparison because electrons do not follow the laws of classical mechanics like planets do.

Q6. Why is an argument from a non-testable hypothesis a problem in science? Answer: It is a major problem in the physical sciences because it weakens the foundation of scientific investigation based on evidence. If a hypothesis cannot be verified or disproven, it cannot be rigorously tested, which is a core requirement of the scientific method.

Q7. What is the danger of the appeal to tradition fallacy in science? Answer: The appeal to tradition (believing something is true just because it's been done for a long time) can hinder the acceptance of new, more precise or effective approaches. It can make scientists resistant to changing old methods or theories.

Q8. How does confirmation bias impact scientific research? Answer: Confirmation bias impacts research because a scientist might unconsciously search for or interpret information that is consistent with their existing beliefs. This leads to the individual ignoring or dismissing information that contradicts their beliefs, which can result in flawed or incomplete conclusions.

Multiple Choice Questions (MCQs)

• Q1. What is cognitive bias?
• A. The process of making decisions based on logical reasoning.
• B. The tendency to make decisions based on personal characteristics and beliefs.
• C. The evaluation of arguments using empirical evidence.
• D. The method of constructing arguments using logical fallacies.
• Correct Answer: B
• Explanation: Cognitive bias is defined as the tendency to make decisions or behave illogically due to personal characteristics.

• Q2. What is a hasty generalization fallacy?
• A. Drawing a conclusion based on a large, representative sample.
• B. Drawing a conclusion based on insufficient evidence.
• C. Drawing a conclusion by misrepresenting an opponent's argument.
• D. Drawing a conclusion based on a false cause-and-effect relationship.
• Correct Answer: B
• Explanation: A hasty generalization is a claim made based on a small, unrepresentative sample, which is insufficient evidence.

• Q3. What does the post hoc ergo propter hoc fallacy assume?
• A. One event is caused by another simply because it follows it.
• B. One event is unrelated to another.
• C. One event is the result of a thorough investigation.
• D. One event is part of a larger series of events.
• Correct Answer: A
• Explanation: This fallacy assumes that if one event occurs after another, the first must be the cause of the second.

• Q4. Which fallacy involves attacking a distorted version of an opponent's claim?
• A. Confirmation Bias
• B. Hasty Generalizations
• C. The Straw Man Fallacy
• D. Redefinition
• Correct Answer: C
• Explanation: The straw man fallacy occurs when someone distorts or exaggerates another's claim and then attacks the distorted version.

• Q5. What does the principle of Occam's Razor advocate?
• A. Choosing the most complex explanation for an event.
• B. Choosing the simplest explanation for an event.
• C. Choosing an explanation based on tradition.
• D. Choosing an explanation based on authority.
• Correct Answer: B
• Explanation: Occam's razor suggests that if there are two possible explanations, you should choose the more straightforward one.

• Q6. What is an example of the appeal to tradition fallacy?
• A. Believing a theory is valid because an expert supports it.
• B. Believing a practice is correct because it has always been done that way.
• C. Believing an argument because it cannot be tested.
• D. Believing a hypothesis because it is the simplest explanation.
• Correct Answer: B
• Explanation: The appeal to tradition is believing something is superior just because it's a traditional practice.

• Q7. Which of the following is a direct consequence of the "fallacy of exclusion" in scientific research?
• A. The research is based on a small sample size.
• B. The research ignores data that contradicts the hypothesis.
• C. The research relies on a famous scientist's opinion.
• D. The research uses a circular argument.
• Correct Answer: B
• Explanation: The fallacy of exclusion involves excluding evidence that could disprove a hypothesis, thus skewing the research.

• Q8. What does the "argument from non-testable hypothesis" do in the context of physical sciences?
• A. It strengthens the evidence base of an investigation.
• B. It proposes a hypothesis that cannot be verified or disproven.
• C. It provides a simple explanation for a complex event.
• D. It relies on the views of a well-known authority.
• Correct Answer: B
• Explanation: This fallacy involves proposing a hypothesis that cannot be verified or disproven, which weakens the foundation of scientific investigation.

• Q9. A student concludes that a new type of fertilizer is ineffective after testing it on only one plant. Which fallacy is the student committing?
• A. Post Hoc Ergo Propter Hoc
• B. The Straw Man Fallacy
• C. Hasty Generalization
• D. False Authority
• Correct Answer: C
• Explanation: The student is drawing a broad conclusion from an insufficient, unrepresentative sample, which is a hasty generalization.

Q10. When a person ignores data that challenges their deeply held belief about a chemical reaction, they are primarily demonstrating: A. Confirmation Bias B. The Appeal to Tradition C. Faulty Analogy D. Begging the Question Correct Answer: A Explanation: Confirmation bias is the tendency to search for or interpret information that is consistent with existing beliefs and to ignore contradictory information.