When teaching critical thinking backfires


Don’t always believe what scientists and other authorities tell you! Be sceptical! Think critically! That’s what I tell my students, ad nauseam. And some learn the lesson too well.

Iwant to give my students the benefit of my hard-won knowledge of science’s fallibility. Early in my career, I was a conventional science writer, easily impressed by scientists’ claims. Fields such as physics, neuroscience, genetics and artificial intelligence seemed to be bearing us toward a future in which bionic superhumans would zoom around the cosmos in warp-drive spaceships. Science was an “endless frontier”, as physicist Vannevar Bush, a founder of the National Science Foundation,1 put it in 1945.

Doubt gradually undermined my faith. Scientists and journalists, I realised, often presented the public with an overly optimistic picture of science. By relentlessly touting scientific “advances”– from theories of cosmic creation and the origin of life to the latest treatments for depression and cancer –and by overlooking all the areas in which scientists were spinning their wheels, we made science seem more potent and fast-moving than it really is.

Science fiction with equations

Now, I urge my students to doubt the claims of physicists that they are on the verge of explaining the origin and structure of the cosmos. Some of these optimists favour string and multiverse theories, which cannot be confirmed by any conceivable experiment. This isn’t physics any more, I declare in class, it’s science fiction with equations!

I give the same treatment to theories of consciousness, which attempt to explain how a three-pound lump of tissue – the brain – generates perceptions, thoughts, memories, emotions and self-awareness. Some enthusiasts assert that scientists will soon reverse-engineer the brain so thoroughly that they will be able to build artificial brains much more powerful than our own.2

Balderdash! I tell my classes (or words to that effect). Scientists have proposed countless theories about how the brain absorbs, stores and processes information, but researchers really have no idea how the brain works. And artificial-intelligence advocates have been promising for decades that robots will soon be as smart as HAL or R2-D2.3 Why should we believe them now?

Maybe, just maybe, I suggest, fields such as particle physics, cosmology and neuroscience are bumping up against insurmountable limits. The big discoveries that can be made have been made. Who says science has to solve every problem?

Bringing in some big guns

Lest my students conclude that I’m some solitary crank, I assign them articles by other sceptics, including a dissection of epidemiology and clinical trials by journalist Gary Taubes in The New York Times.4 He advises readers to doubt dramatic claims about the benefits of some new drug or diet, especially if the claim is new. “Assume that the first report of an association is incorrect or meaningless,” Taubes writes, because it probably is. “So be sceptical.”5

To drive this point home, I assign articles by John Ioannidis, an epidemiologist who has exposed the flimsiness of most peer- reviewed research. In a 2005 study,6 he concluded that “most published research findings are false”. He and his colleagues contend that “the more extreme, spectacular results (the largest treatment effects, the strongest associations, or the most unusually novel and exciting biological stories) may be preferentially published”.7 These sorts of dramatic claims are also more likely to be wrong.

The cherry on this ice-cream sundae of doubt is a critique by psychologist Philip Tetlock of expertise in soft sciences, such as politics, history, and economics. In his 2005 book Expert Political Judgment: How Good Is It? How Can We Know?,8 Tetlock presents the results of his 20-year study of the ability of 284 “experts” in politics and economics to make predictions about current affairs. The experts did worse than random guessing, or “dart-throwing monkeys”, as Tetlock puts it.

Rascally rodents

Like Ioannidis, Tetlock found a correlation between the prominence of experts and their fallibility. The more wrong the experts were, the more visible they were in the media. The reason, he conjectures, is that experts who make dramatic claims are more likely to get airtime on America’s Cable News Network (CNN) or column inches in The Washington Post, even though they are likelier to be wrong.

For comic relief, I tell my students about a maze study, cited by Tetlock,9 that pitted rats against Yale undergraduates.10 Sixty per cent of the time, researchers placed food on the left side of a fork in the maze; otherwise the food was placed randomly. After figuring out that the food was more often on the left side of the fork, the rats turned left every time and so were right 60% of the time. Yale students, discerning illusory patterns of left-right placement, guessed right only 52% of the time. Yes, the rats beat the “Yalies”! The smarter you are, the more likely you may be to “discover” patterns in the world that aren’t actually there.

Some seriously commit to scepticism

So how do my students respond to my sceptical teaching? Some react with healthy pushback, especially to my suggestion that the era of really big scientific discoveries might be over. “On a scale from toddler knowledge to ultimate enlightenment, man’s understanding of the universe could be anywhere,” wrote a student named Matt. “How can a person say with certainty that everything is known or close to being known if it is incomparable to anything?”

Other students embrace scepticism to a degree that dismays me. Cecelia, a biomedical-engineering major, wrote: “I am sceptical of the methods used to collect data on climate change, the analysis of this data, and the predictions made based on this data.” Pondering the lesson that correlation does not equal causation, Steve questioned the foundations of scientific reasoning. “How do we know there is a cause for anything?” he asked.

In a similar vein, some students echoed the claim of radical postmodernists that we can never really know anything for certain, and hence that almost all our current theories will probablybeoverturned.11JustasAristotle’sphysicsgavewayto Newton’s, which in turn yielded to Einstein’s, so our current theories of physics will surely be replaced by radically different ones.12

Caveat emptor?

After one especially doubt-riddled crop of papers, I responded, “Whoa!” (or words to that effect). Science, I lectured sternly, has established many facts about reality beyond a reasonable doubt, embodied by quantum mechanics, general relativity, the theory of evolution, the genetic code. This knowledge has yielded applications – from vaccines to computer chips – that have transformed our world in countless ways. It is precisely because science is such a powerful mode of knowledge, I said, that you must treat new pronouncements sceptically, carefully distinguishing the genuine from the spurious. But you shouldn’t be so sceptical that you deny the possibility of achieving any knowledge at all.

My students listened politely, but I could see the doubt in their eyes. We professors have a duty to teach our students to be sceptical. But we also have to accept that, if we do our jobs well, their scepticism may turn on us.

John Horgan is an award-winning author and science journalist and director of the Centre for Science Writings at Stevens Institute of Technology, Hoboken, New Jersey in the US. A former senior writer at Scientific American, he has also written for The New York Times, National Geographic, Time, Newsweek, The Washington Post, Slate and other publications around the world. This article appeared at: https://blogs.scientif icamerican.com on 14 December 2015, and appears here with the kind permission of the author.


1. See: https://www.nsf.gov/.
2. See, for example: http://www.engineeringchallenges.org/challenges/9109.aspx. 3. See, for example: http://www.robothalloffame.org/inductees/

4. See: http://www.nytimes.com/2007/09/16/magazine/16epidemiology-

t.html?_r=0. 5. Ibid.

6. See: http://journals.plos.org/plosmedicine/article?id=10.1371/journal.pmed. 0020124.

7. Ibid.
8. Tetlock, P.E. (2006) Expert Political Judgment: How Good Is It? How Can

We Know? New edition. New Jersey: Princeton University Press.
9. See: http://psych.wisc.edu/braun/281/Intelligence/LabellingEffects.htm.
10. YaleUniversityisaprivateIvyLeagueresearchuniversityinNewHaven,

Connecticut, in the US. See: http://www.yale.edu/.
11. See,forexample:http://steamdoc.s5.com/Postmodern/Chapter4.pdf.
12. See,forexample:https://www.scribd.com/document/195527932/Natural-Motion-in-Physics-Aristotle-Newton-Einstein.

Category: Winter 2017

About the Author ()

News posts added for Independent Education by Global Latitude DMA

Leave a Reply

Your email address will not be published. Required fields are marked *