Knowing What You Don't Know

Most people underestimate how much they don't know. Most people also underestimate how much they don't know about what they don't know.

This is the structure of epistemic humility — not just acknowledging the limits of your knowledge, but maintaining genuine uncertainty about the shape of those limits.

Psychologists distinguish three kinds of ignorance. Known knowns: things you know you know. Known unknowns: things you know you don't know. And unknown unknowns: things you don't even know you don't know. The third category is the dangerous one, because you can't account for what you can't see.

## The Expert Problem

A striking finding in forecasting research: domain experts are often worse at predicting outcomes in their own field than intelligent generalists who express less confidence. Philip Tetlock's superforecaster research showed that experts tend to have a "one big idea" — a dominant causal model that they apply to every situation.

The experts aren't less smart. They're worse calibrated. Their years of experience haven't made them more uncertain — they've made them more confident in their particular framework. And when reality doesn't fit the framework, they explain it away rather than update.

## Why Calibration Matters More Than Confidence

A perfectly calibrated forecaster who says "70% confident" is right about 70% of the time in that class of prediction. A poorly calibrated one who says 70% might be right only 55% of the time — or 90%. Both people feel equally confident.

The problem is that confidence feels like evidence. When someone speaks with authority about an uncertain domain, listeners often update toward the speaker's view more than the evidence warrants. And we often do this to ourselves — internal confidence starts feeling like knowledge.

Calibration training helps. Keeping a prediction log — writing down explicit probability estimates and tracking outcomes over time — reveals systematic over- or underconfidence. Most people who do this discover they're overconfident about most things.

## The Practical Discipline

What does epistemic humility look like in practice? A few things:

Distinguishing "I believe X" from "I know X." These feel similar but have different epistemic statuses. "I believe the market will recover" is a probability estimate. "I know interest rates will fall" is a knowledge claim. The second one requires much stronger evidence.

Actively seeking disconfirming evidence. The natural tendency is to look for evidence that confirms what you already believe. The deliberate countermove is to ask: what would have to be true for me to be wrong? Then look for that.

Holding beliefs at appropriate strengths. Some things we genuinely should be very confident about — the earth is not flat. Others we should hold loosely — most political predictions, complex causal chains, long-range forecasts. The mistake is applying the same confidence level to both.

## The Social Dimension

There's a cost to expressed uncertainty in social contexts. People who hedge their predictions are sometimes perceived as weak or indecisive. Confident speakers attract followers, even when their track records are poor.

This creates a selection pressure for overconfidence in public discourse. The mechanism is worth understanding: confident claims generate attention and authority, regardless of their accuracy. Calibrated uncertainty sounds like "it depends," which isn't satisfying but is often accurate.

The rationalist tradition suggests that epistemic humility is a terminal value — good in itself, not just instrumentally. Whether or not that's true, it has clear instrumental value for anyone who needs to make good decisions in an uncertain world. Which is everyone.

Knowing What You Don't Know

// COMMENTS

ON THIS PAGE