Opens in a new tab
15 min 08 sec
Available in:Englishไทย

Superforecasting: The Art and Science of Prediction

Shows how ordinary volunteers learned to predict world events more accurately than experts. It teaches their habits: splitting questions, testing your own bias, thinking in precise probabilities, updating with care and learning from scored mistakes.

Table of Content

Most of us make big bets on the future, such as a new job, a move abroad or a house, with no idea whether our predictions are any good. In Superforecasting, psychologist Philip E. Tetlock and journalist Dan Gardner report that a small group of ordinary volunteers predicted world events about 60 percent more accurately than regular forecasters. The people in this group are not who you might expect. They include a retired government worker, a mathematics professor and an economist whose retirement savings took a hit in the 2007 crisis.

The authors argue that good forecasting depends on how you think, gather information and change your mind. They hold that anyone careful and determined can learn those habits. You will meet the questions these forecasters faced, from poison in a dead leader’s remains to a prime minister’s visit to a shrine. You will also learn the specific moves that turned their guesses into numbers worth trusting, and how to use those moves on your own decisions.

A retired agriculture official in Arizona answers the kind of world-affairs questions that stump intelligence agencies, and his scored record is remarkable. What a four-year tournament revealed about people like him matters for every big decision you make.

Asked whether a leader had been poisoned, most people would reach for politics first. The best forecasters started somewhere far less obvious, and that choice of starting point protected them from a whole family of errors.

The way a question is worded steers you toward certain evidence before you start thinking. A visa question about the Dalai Lama shows how one small rewording brings the evidence you would have missed into view.

In the meeting about Osama bin Laden’s hideout, estimates ranged from 30 to 95 percent, and the president summed them up in one blunt phrase. That instinct is ancient, and it quietly costs accuracy.

Even a top forecaster can ignore the tip that matters or overreact to a report that is already out of date. Two missed calls, one about a shrine and one about Arctic ice, show where the balance lies.

An economist who missed the 2007 crash, an investor who lost heavily and a group of police officers all point to the same missing ingredient for better judgment. Bridge players and weather forecasters already have it.

Superforecasting ends up making a hopeful claim about ordinary people. A retiree in Arizona, a mathematician and an economist burned by a crash outperformed experts, and none of them needed a genius-level IQ to do it. Their edge was a disciplined way of handling uncertainty that anyone determined enough can copy. They break the question apart and hunt for evidence against their favorite answer. They speak in precise numbers, adjust as facts arrive and keep score.

The approach fits decisions you already face. Before your next big choice, such as a job offer, a move or a large purchase, list the few things that must be true and estimate each one. Ask the question in its reverse form and gather evidence for that version as well. Give your final answer as a percentage, write it down with a date, and come back to it when the result is in. As news arrives, revise in steps and watch for the two classic slips: dismissing a signal that matters and leaping at an outdated report.

None of this promises a correct call every time. Flack still got Abe wrong. What the method does offer is a forecasting record that gets better each year you keep it.

About this book

What is this book about?

Every big life decision, from changing jobs to retiring, rests on a prediction, and most people never find out whether their predictions are any good. Even experts often do poorly. Philip E. Tetlock and Dan Gardner tell the story of a group that does far better: volunteers in the Good Judgment Project. The project competed in a four-year forecasting tournament on nearly 500 questions about world affairs. It beat the control group by 60 percent in its first year and by 78 percent in its second. The authors argue that the best of these forecasters succeed through habits of thought that any careful person can learn. They show those habits at work through cases such as the testing of Yasser Arafat's remains for polonium, the debate over Osama bin Laden's whereabouts and a Japanese prime minister's visit to a shrine. The forecasters break questions into parts and reword them to catch bias. They put fine-grained numbers on uncertainty and revise their forecasts as news arrives. Readers get a practical method for judging what is likely to happen. They also get the feedback routine that, in the authors' account, makes a thoughtful forecaster steadily better.

Book Information

Rating:

Genre:

Psychology

Topics:

Cognitive Biases, Critical Thinking, Decision-Making

Publisher:

Penguin Random House

Language:

English, ไทย

Narrator:

Meredith

First published:

September 29, 2015

Pages:

352

Length:

15 min 08 sec

Get the book:

Amazon

Who it's for

  • Wanting measurable predictions

    Professionals and founders who bet on markets, hires or launches and want predictions they can measure and improve.

  • Professional forecasters

    Analysts, planners and policy people who forecast for a living and want a disciplined method.

  • Facing a big decision

    Anyone facing a big personal decision, such as a job change or a move, who wants to think clearly about the odds.

Listen to Preview

About the Author

Philip E. Tetlock

Philip E. Tetlock, born in Toronto in 1954, is Annenberg University Professor at the University of Pennsylvania, with appointments at Wharton and the School of Arts and Sciences. He co-leads the Good Judgment Project, a multiyear study of whether forecasts of major world events can become more accurate. He also wrote Expert Political Judgment and was elected to the American Philosophical Society in 2019. Dan Gardner trained in law and history and advised the Premier of Ontario. His reporting at the Ottawa Citizen earned wins or nominations for leading Canadian journalism awards. He wrote Risk, became editor of Policy Options in 2015 and lectures on forecasting and decision-making.

Ratings & Reviews

Ratings at a glance

3.8

Overall score based on 140 ratings.

What people think

Listeners find the book exceptionally clear and articulate, commending its deep analysis and stimulating material regarding decision-making and critical thinking. Furthermore, the book earns praise for its precision in forecasting, as one listener highlights its solid conclusions based on probability analysis. Listeners also value the engaging anecdotes, fascinating ideas, and the practical utility offered to decision-makers, with one listener noting it is essential reading for leaders.

Top reviews

Maksim

Ever wonder why the 'experts' on TV are almost always wrong? Tetlock explores the world of the Good Judgment Project to show that being a great forecaster isn't about having a high IQ or a fancy degree. It’s actually about having a specific mindset—one that values intellectual humility and constant, incremental updates to beliefs. I found the section on Bayesian methodology particularly enlightening because it offers a practical way to refine our own decision-making processes. The writing is surprisingly fluid for a book about data, and Gardner does a great job making the social science feel like a gripping narrative. If you’re a leader who needs to make high-stakes calls, this is absolutely essential reading. It transforms abstract probability into a tangible tool for everyday life.

Show more
Pacharapol

As someone who deals with risk management, I found this analysis of the IARPA project incredibly thought-provoking. The authors do a fantastic job of breaking down how 'superforecasters' outperform intelligence analysts by using logic instead of just gut feeling. Look, the book isn't perfect; it sometimes meanders into US foreign policy territory that feels a bit disconnected from the core statistical theory. However, the insights into cognitive biases and the 'fox vs. hedgehog' distinction are pure gold. To be fair, it’s much more readable than most academic texts on probability. It forces you to look at the 'really big pile of evidence' from the Iraq War through a much more skeptical, rigorous lens. A masterpiece of evidence-based thought.

Show more
Fort

Wow. This completely changed how I think about my own certainties and the way I process new information daily. The concept of 'unpacking' a question into its component parts—Fermi-style—is a game-changer for anyone trying to navigate an uncertain future. Tetlock explains that these elite forecasters aren't psychic; they are just better at spotting their own biases and adjusting their estimates as new data rolls in. The stories about ordinary people—like the one about the fictional vs. real Leon Panetta—add a human element that keeps the pages turning. It’s a compelling argument for why we should stop listening to confident gurus and start trusting those who are willing to say 'I don't know yet.' Highly recommended for anyone wanting to sharpen their mind.

Show more
Eleni

Finally got around to reading this and it’s a masterclass in understanding how the human mind handles uncertainty. The authors argue that forecasting is a skill that can be cultivated through practice, feedback, and a rigorous commitment to the truth. Unlike many business books that rely on 'gut feeling' success stories, this is backed by years of actual data from the Good Judgment Project. It’s fascinating to see how ordinary citizens could outperform professional analysts just by following a few core principles of logic. If you enjoyed 'The Signal and the Noise' by Nate Silver, you will find this to be a perfect companion piece. This should be mandatory reading for anyone in a leadership position today. Truly insightful stuff.

Show more
Joseph

To be fair, I didn't think a book about statistical prediction would be this engaging, but the storytelling is top-notch. The way Tetlock explains the difference between 'hedgehogs' who know one big thing and 'foxes' who know many small things is incredibly useful. It highlights why we often fall for charismatic leaders who offer simple answers to complex problems when we should be looking for nuance instead. The emphasis on tracking your own track record is a simple but revolutionary idea for most of us. This isn't just a book about politics or the CIA; it’s a guide on how to live a more examined, logical life in an increasingly chaotic world. It’s the kind of book you’ll want to highlight on every page.

Show more
Yongyut

Picked this up after seeing it on several 'must-read' lists for entrepreneurs, and I’m glad I finally did. The writing style is very accessible, which is a relief given how dry the subject of probability can usually be. I appreciated the emphasis on 'intellectual humility'—the idea that we need to be willing to admit when our initial assumptions are wrong. My only gripe is that it feels a bit repetitive in the middle sections where it goes over the same IARPA results multiple times. Still, the practical value for decision-makers is undeniable, and the case studies are genuinely interesting. It’s a solid 4-star read that encourages you to think more like a 'fox' than a 'hedgehog.' It definitely makes you question your first instincts.

Show more
Rungrat

After hearing so much hype about 'superforecasting,' I was skeptical, but the book largely delivers on its promise of improving critical thinking. Tetlock and Gardner show that the key to predicting the future isn't a crystal ball but a willingness to break down complex problems into smaller, manageable pieces. I loved the section on how 'teams' can either succumb to groupthink or become more than the sum of their parts through healthy debate. Truth is, we all have blind spots, and this book provides a toolkit for identifying them before they lead to disastrous conclusions. It bridges the gap between the abstract concepts of behavioral economics and the real-world application of those theories in high-pressure environments. A very solid conclusion to his years of research.

Show more
Fatima

Not what I expected when I picked this up. I was looking for a technical manual on forecasting models, but instead, I got a lot of political commentary and anecdotes about the CIA. While the discussion on Archie Cochrane and evidence-based medicine was a strong start, the book eventually gets bogged down in subjective certitude disguised as probability. Frankly, calling a personal hunch a 'percentage' doesn't make it science, and the author's defense of certain intelligence failures felt a bit too polite. It’s a decent summary of themes found in 'Thinking, Fast and Slow,' but it lacks the same level of rigorous depth. Good for a casual reader, but maybe too watered down for a stats nerd who wants hard equations over stories.

Show more
Manee

This book starts off incredibly strong but loses its way somewhere in the second half. The initial discussions on cognitive biases and the failures of 'expert' talking heads were brilliant and kept me hooked for the first hundred pages. However, once the focus shifts entirely to the US government's IARPA experiments, it starts to feel a bit like a long-winded report. The repetition of the central message—revise your predictions, use numbers, avoid bias—becomes a bit tedious after a while. I was hoping for more diverse examples outside of US foreign policy and intelligence. It’s worth reading for the first half alone, but be prepared for some dry sections later on. It's interesting but ultimately a bit overlong.

Show more
Rin

The chapter on political theory ruined what could have been a great book on statistics. I wanted a cut-and-dry analysis of predictive modeling, but what I got was a lot of propaganda and critique of US intelligence programs that felt out of place. Personally, I found the comparisons to the Iraq War fiasco to be missing the point entirely regarding how evidence-based practice should actually function. If a doctor gives you poison and monitors the results, that isn't science—it’s just bad practice. This book tries to combine too many disparate ideas and ends up feeling superficial in its attempt to bridge the gap between data and history. Pass on this if you want real math. It's too focused on subjective degrees of certitude.

Show more
Show all reviews

Questions about this book

Philip E. Tetlock and Dan Gardner argue that accurate forecasting depends on how people think, gather information and update their beliefs. Raw talent and IQ matter less than those habits. In a four-year tournament with nearly 500 questions on world affairs, volunteers in the Good Judgment Project beat the control group by 60 percent in the first year and 78 percent in the second. The best of them used habits that any careful, determined person can learn.

Superforecasters break hard questions into smaller ones, as they did when they first checked whether polonium could still be detected in Yasser Arafat’s remains. They reword questions to catch their own bias and seek out other views. They also give precise probabilities instead of a vague fifty-fifty. Finally, they revise their forecasts often as new information arrives and learn from feedback on their misses.

Philip Tetlock created this research project jointly with a pair of other academics from Penn. It was one of five teams in a forecasting tournament set up by the Intelligence Advanced Research Projects Activity. Thousands of volunteers from all walks of life answered questions about world events, and independent scientists scored their forecasts. About two percent, such as retiree Bill Flack, became superforecasters.

Before a big decision, split your forecast into the few things that must be true and judge each one. Ask the reverse version of the question to surface evidence you might ignore. State your answer as a specific percentage and write it down with a date. Update in steps as news arrives, then score yourself once the outcome is known, so that you get the feedback that helps meteorologists and bridge players improve.

Featured in

AUDIO SUMMARY AVAILABLE

Listen to Superforecasting in 15 minutes

Get the key ideas from Superforecasting by Philip E. Tetlock, plus 5,000+ more nonfiction titles.

  • 5,000+ titles
  • Listen as much as you want
  • 7-day free trial
  • Cancel anytime

Superforecasting

Preview · Full summary 15 min 08 sec
Home

Discover

Open app

Log in