from training.npr.org: https://training.npr.org/2020/02/19/triage-your-fact-checking-a-method/
Triage your fact-checking: a method (and board game)
As a reporter or editor, you’re told to confirm every fact. If you spend hours triple-checking even the most plausible tidbit of non-controversial information, though, you might never get the story out.
So, to help you think about journalistic accuracy, we’ve developed a fact-checking triage method.
Fact-checking triage doesn’t mean not checking certain facts. It’s a framework for making quick decisions about what to confirm, cut and/or attribute.
The method is encapsulated on this four-quadrant card, which we use in our fact-checking training sessions:
Non-controversial, easy to verify: The spelling of someone’s name, for instance. Check it against a primary source. Check it again. Check it one more time for good measure.
Controversial, easy to verify: This is the same as above. Gun statistic from a new study? Check it against a primary source. Check it again. Check it one more time for good measure. (That is, assuming you’ve done your due diligence and it’s a robust study, a reliable source, and so on.) And attribute it.
Non-controversial, hard to verify: Here falls stuff like “Holly got straight smiley-faces in kindergarten.” If you’re writing a general profile of Holly, decades later, go with “Holly said she got straight smiley-faces in kindergarten.” If the story is about Holly’s pattern of fibbing about academic performance, or grade inflation in kindergarten, then ask to see the report card, contact the elementary school, etc.
Controversial, hard to verify: If Barry tells you his niece is an off-the-grid civet farmer in Maine, decide if this information is worth plunging into the Maine wilderness to prove, or whether you should just cut it. As above, it depends on what your story is about. (And on your travel budget. And tolerance for pungent nocturnal mammals.)
Once you decide in which quadrant your fact falls, consider these additional questions:
- Who disagrees, and how much? The controversy metric is relative. “Naked mole rats are violent in the wild” is both controversial (to a naked mole rat researcher) and exceedingly difficult to prove (as naked mole rats live underground).
- How unimpeachable is your primary source? Example: The Smithsonian tells you such-and-such Basque word means “ceiling fan.” Do you trust the nation’s preeminent museum system, or do you call a Basque speaker?
To illustrate the challenge of categorizing a fact, we made this board (get the full-size PDF) for fact-checking training sessions. Have your journalists put different facts (we’ve provided some here) on the grid and compare the results. Or show a few facts to the group and let your rapt audience members decide where to put them.
Here’s a completed grid from Mark Memmott, NPR’s former standards and practices editor:
Ideally, you could check every fact until it reaches virtual infallibility. But this is not an ideal world — or, at least, it won’t be until journalists achieve god-like omniscience.